Jun 02 15:21:14.211744 ip-10-0-141-151 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 15:21:14.211756 ip-10-0-141-151 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 15:21:14.211763 ip-10-0-141-151 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 15:21:14.211981 ip-10-0-141-151 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 15:21:24.461109 ip-10-0-141-151 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 15:21:24.461127 ip-10-0-141-151 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 46b9d32129924b84857eed73b12112eb -- Jun 02 15:23:53.268853 ip-10-0-141-151 systemd[1]: Starting Kubernetes Kubelet... Jun 02 15:23:53.748941 ip-10-0-141-151 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:53.748941 ip-10-0-141-151 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 15:23:53.748941 ip-10-0-141-151 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:53.748941 ip-10-0-141-151 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 15:23:53.748941 ip-10-0-141-151 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:53.752751 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.752646 2579 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 15:23:53.759813 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759786 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:53.759813 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759808 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:53.759813 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759815 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:53.759813 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759820 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759824 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759828 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759832 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759837 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759840 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759845 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759849 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759853 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759856 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759860 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759864 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759868 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759872 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759875 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759879 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759886 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759889 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759893 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:53.760074 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759896 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759900 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759904 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759908 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759912 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759916 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759920 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759933 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759937 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759942 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759945 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759949 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759955 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759962 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759968 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759973 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759977 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759982 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759986 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759990 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:53.760701 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759994 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.759999 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760002 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760007 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760011 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760015 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760019 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760023 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760028 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760032 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760036 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760040 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760044 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760048 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760052 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760056 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760060 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760064 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760068 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760072 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:53.761224 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760077 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760081 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760085 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760089 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760092 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760096 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760100 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760108 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760114 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760120 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760124 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760129 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760133 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760137 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760142 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760147 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760152 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760157 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760162 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760166 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:53.761732 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760169 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:53.762407 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760174 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:53.762407 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760177 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:53.762407 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.760182 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762475 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762486 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762491 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762497 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762501 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762506 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762511 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762515 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762520 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762525 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762530 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762534 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762538 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:53.762536 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762543 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762548 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762552 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762556 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762561 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762565 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762589 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762593 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762597 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762601 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762605 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762610 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762614 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762618 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762622 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762626 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762629 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762634 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762638 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762642 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:53.763159 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762647 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762651 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762655 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762662 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762668 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762672 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762676 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762680 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762684 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762688 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762693 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762697 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762701 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762705 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762710 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762715 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762719 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762723 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762728 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762732 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:53.764053 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762736 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762741 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762745 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762749 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762755 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762759 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762764 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762769 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762773 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762778 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762781 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762785 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762789 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762793 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762797 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762801 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762805 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762809 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762813 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762817 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:53.764734 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762822 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762826 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762830 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762833 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762838 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762842 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762847 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762854 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762860 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762874 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762879 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762883 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.762888 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763007 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763024 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763034 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763041 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763048 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763055 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763067 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763074 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 15:23:53.765234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763079 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763083 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763089 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763094 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763099 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763104 2579 flags.go:64] FLAG: --cgroup-root="" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763108 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763113 2579 flags.go:64] FLAG: --client-ca-file="" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763117 2579 flags.go:64] FLAG: --cloud-config="" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763122 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763127 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763133 2579 flags.go:64] FLAG: --cluster-domain="" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763138 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763143 2579 flags.go:64] FLAG: --config-dir="" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763148 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763153 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763158 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763164 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763169 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763174 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763179 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763183 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763188 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763192 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763197 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 15:23:53.765859 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763204 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763209 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763214 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763218 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763224 2579 flags.go:64] FLAG: --enable-server="true" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763228 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763235 2579 flags.go:64] FLAG: --event-burst="100" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763241 2579 flags.go:64] FLAG: --event-qps="50" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763245 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763250 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763255 2579 flags.go:64] FLAG: --eviction-hard="" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763261 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763266 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763270 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763275 2579 flags.go:64] FLAG: --eviction-soft="" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763279 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763284 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763289 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763294 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763299 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763303 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763308 2579 flags.go:64] FLAG: --feature-gates="" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763314 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763319 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763325 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 15:23:53.766742 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763331 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763336 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763341 2579 flags.go:64] FLAG: --help="false" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763345 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-151.ec2.internal" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763350 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763355 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763360 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763366 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763372 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763376 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763381 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763385 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763391 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763395 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763400 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763405 2579 flags.go:64] FLAG: --kube-reserved="" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763410 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763415 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763420 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763424 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763429 2579 flags.go:64] FLAG: --lock-file="" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763433 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763437 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763442 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 15:23:53.767395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763451 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763456 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763460 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763465 2579 flags.go:64] FLAG: --logging-format="text" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763470 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763475 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763480 2579 flags.go:64] FLAG: --manifest-url="" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763484 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763492 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763497 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763504 2579 flags.go:64] FLAG: --max-pods="110" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763508 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763513 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763518 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763523 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763528 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763532 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763538 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763549 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763554 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763559 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763565 2579 flags.go:64] FLAG: --pod-cidr="" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763590 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 15:23:53.768102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763598 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763603 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763608 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763613 2579 flags.go:64] FLAG: --port="10250" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763618 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763623 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056a0f78a9c2fa63e" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763628 2579 flags.go:64] FLAG: --qos-reserved="" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763633 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763638 2579 flags.go:64] FLAG: --register-node="true" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763647 2579 flags.go:64] FLAG: --register-schedulable="true" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763652 2579 flags.go:64] FLAG: --register-with-taints="" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763658 2579 flags.go:64] FLAG: --registry-burst="10" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763663 2579 flags.go:64] FLAG: --registry-qps="5" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763667 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763672 2579 flags.go:64] FLAG: --reserved-memory="" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763678 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763683 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763688 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763693 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763698 2579 flags.go:64] FLAG: --runonce="false" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763702 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763708 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763713 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763718 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763723 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763728 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 15:23:53.768737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763733 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763738 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763743 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763748 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763752 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763758 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763762 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763767 2579 flags.go:64] FLAG: --system-cgroups="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763772 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763781 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763786 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763790 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763796 2579 flags.go:64] FLAG: --tls-min-version="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763801 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763806 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763812 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763816 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763821 2579 flags.go:64] FLAG: --v="2" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763828 2579 flags.go:64] FLAG: --version="false" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763834 2579 flags.go:64] FLAG: --vmodule="" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763840 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.763846 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.763998 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764007 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:53.769375 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764012 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764017 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764022 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764027 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764031 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764037 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764042 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764046 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764051 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764055 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764059 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764063 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764067 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764071 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764076 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764082 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764087 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764091 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764094 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764099 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:53.770010 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764103 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764107 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764111 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764117 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764120 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764124 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764128 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764132 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764136 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764141 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764145 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764149 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764153 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764157 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764161 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764165 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764169 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764173 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764179 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764183 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:53.770523 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764187 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764191 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764196 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764200 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764204 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764208 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764212 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764218 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764223 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764227 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764233 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764239 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764244 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764248 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764252 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764258 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764262 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764267 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764271 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:53.771191 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764275 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764279 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764283 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764288 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764291 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764295 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764299 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764303 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764307 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764312 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764316 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764320 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764324 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764328 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764332 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764336 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764340 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764345 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764349 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764353 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:53.771733 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764359 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:53.772233 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764364 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:53.772233 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764368 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:53.772233 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764372 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:53.772233 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.764376 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:53.772233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.765320 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:53.772622 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.772600 2579 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 15:23:53.772659 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.772622 2579 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 15:23:53.772689 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772673 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:53.772689 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772679 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:53.772689 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772682 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:53.772689 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772685 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:53.772689 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772688 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:53.772689 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772691 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772694 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772697 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772700 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772703 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772705 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772708 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772710 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772713 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772716 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772718 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772721 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772723 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772725 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772735 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772738 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772740 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772743 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772745 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772748 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:53.772839 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772751 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772753 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772756 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772759 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772761 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772763 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772772 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772774 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772777 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772780 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772785 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772787 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772790 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772793 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772796 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772798 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772801 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772804 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772806 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:53.773331 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772809 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772811 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772813 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772816 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772819 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772821 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772823 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772827 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772831 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772834 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772836 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772839 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772842 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772844 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772847 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772850 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772853 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772855 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772857 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:53.773822 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772860 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772863 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772866 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772868 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772871 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772873 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772875 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772879 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772882 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772884 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772887 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772889 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772891 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772893 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772896 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772898 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772901 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772903 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772905 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772908 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:53.774278 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772910 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772912 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.772915 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.772920 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773025 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773029 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773032 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773035 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773038 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773041 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773043 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773046 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773049 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773052 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773055 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773058 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:53.774857 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773060 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773062 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773065 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773067 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773071 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773073 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773076 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773078 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773080 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773083 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773085 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773088 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773090 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773092 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773095 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773097 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773100 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773102 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773105 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:53.775267 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773108 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773111 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773114 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773116 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773120 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773122 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773125 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773127 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773130 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773132 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773135 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773137 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773140 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773143 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773145 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773147 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773150 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773152 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773155 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:53.775752 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773157 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773160 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773163 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773165 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773167 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773170 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773172 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773175 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773177 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773180 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773182 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773184 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773187 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773189 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773191 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773194 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773196 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773198 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773201 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773203 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:53.776232 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773205 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773208 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773210 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773212 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773215 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773217 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773222 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773225 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773228 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773231 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773233 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773236 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773239 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773241 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773243 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:53.776741 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:53.773246 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:53.777107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.773250 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:53.777107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.774095 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 15:23:53.777107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.776263 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 15:23:53.777279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.777267 2579 server.go:1019] "Starting client certificate rotation" Jun 02 15:23:53.777385 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.777371 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:23:53.777415 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.777401 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:23:53.803725 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.803702 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:23:53.807599 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.807563 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:23:53.828455 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.828439 2579 log.go:25] "Validated CRI v1 runtime API" Jun 02 15:23:53.834150 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.834135 2579 log.go:25] "Validated CRI v1 image API" Jun 02 15:23:53.838060 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.838041 2579 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 15:23:53.840666 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.840646 2579 fs.go:135] Filesystem UUIDs: map[1624eaf4-d2d2-4b4a-ba59-79c41395f55f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c80e3538-828f-48ce-ade5-6bf588a175de:/dev/nvme0n1p4] Jun 02 15:23:53.840715 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.840667 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 15:23:53.843231 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.843211 2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:23:53.845179 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.845067 2579 manager.go:217] Machine: {Timestamp:2026-06-02 15:23:53.84452583 +0000 UTC m=+0.450218515 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099928 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec243ad7c0637b7f1fea2769fbe5d272 SystemUUID:ec243ad7-c063-7b7f-1fea-2769fbe5d272 BootID:46b9d321-2992-4b84-857e-ed73b12112eb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:a7:12:74:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:a7:12:74:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f1:90:63:45:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 15:23:53.846072 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.846061 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 15:23:53.846161 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.846149 2579 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 15:23:53.849890 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.849862 2579 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 15:23:53.850035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.849892 2579 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-151.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 15:23:53.850083 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.850045 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 15:23:53.850083 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.850053 2579 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 15:23:53.850083 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.850061 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:23:53.850830 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.850820 2579 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:23:53.853188 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.853177 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:23:53.853297 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.853288 2579 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 15:23:53.855860 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.855850 2579 kubelet.go:491] "Attempting to sync node with API server" Jun 02 15:23:53.855896 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.855869 2579 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 15:23:53.855896 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.855882 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 15:23:53.855896 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.855892 2579 kubelet.go:397] "Adding apiserver pod source" Jun 02 15:23:53.856003 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.855907 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 15:23:53.863313 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.858265 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:23:53.863313 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.858289 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:23:53.865287 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.865268 2579 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 15:23:53.867259 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.867242 2579 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 15:23:53.869125 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869110 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869132 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869142 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869150 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869162 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869172 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869181 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869189 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869200 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 15:23:53.869207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869209 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 15:23:53.869523 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869222 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 15:23:53.869523 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.869231 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 15:23:53.870665 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.870652 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 15:23:53.870725 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.870669 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 15:23:53.871499 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.871478 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:23:53.871499 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.871484 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 15:23:53.877164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.877148 2579 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 15:23:53.877254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.877194 2579 server.go:1295] "Started kubelet" Jun 02 15:23:53.877303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.877265 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 15:23:53.877348 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.877279 2579 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 15:23:53.877348 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.877341 2579 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 15:23:53.878075 ip-10-0-141-151 systemd[1]: Started Kubernetes Kubelet. Jun 02 15:23:53.878658 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.878488 2579 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 15:23:53.881759 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.881738 2579 server.go:317] "Adding debug handlers to kubelet server" Jun 02 15:23:53.882152 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.882103 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9v776" Jun 02 15:23:53.884426 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.884412 2579 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-151.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 15:23:53.884931 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.884905 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 15:23:53.885431 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.884450 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-151.ec2.internal.18b54cf2e9708b64 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-151.ec2.internal,UID:ip-10-0-141-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-151.ec2.internal,},FirstTimestamp:2026-06-02 15:23:53.877162852 +0000 UTC m=+0.482855545,LastTimestamp:2026-06-02 15:23:53.877162852 +0000 UTC m=+0.482855545,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-151.ec2.internal,}" Jun 02 15:23:53.885538 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.885510 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 15:23:53.885761 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.885738 2579 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 15:23:53.885761 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.885757 2579 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 15:23:53.885893 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.885877 2579 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 15:23:53.885944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.885911 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 02 15:23:53.885944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.885919 2579 reconciler.go:26] "Reconciler: start to sync state" Jun 02 15:23:53.886284 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886266 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 15:23:53.886406 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886286 2579 factory.go:55] Registering systemd factory Jun 02 15:23:53.886406 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886296 2579 factory.go:223] Registration of the systemd container factory successfully Jun 02 15:23:53.886544 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886529 2579 factory.go:153] Registering CRI-O factory Jun 02 15:23:53.886637 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886550 2579 factory.go:223] Registration of the crio container factory successfully Jun 02 15:23:53.886637 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886566 2579 factory.go:103] Registering Raw factory Jun 02 15:23:53.886637 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886595 2579 manager.go:1196] Started watching for new ooms in manager Jun 02 15:23:53.887082 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.886982 2579 manager.go:319] Starting recovery of all containers Jun 02 15:23:53.888681 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.888656 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:53.888987 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.888967 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9v776" Jun 02 15:23:53.891335 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.891187 2579 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 15:23:53.896983 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.896966 2579 manager.go:324] Recovery completed Jun 02 15:23:53.898329 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.898283 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 15:23:53.899064 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.899047 2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:53.901538 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.901522 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:53.902192 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.902176 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-151.ec2.internal\" not found" node="ip-10-0-141-151.ec2.internal" Jun 02 15:23:53.903511 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.903494 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:53.903589 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.903524 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:53.903589 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.903535 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:53.904082 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.904067 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 15:23:53.904082 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.904081 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 15:23:53.904209 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.904109 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:23:53.906436 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.906422 2579 policy_none.go:49] "None policy: Start" Jun 02 15:23:53.906513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.906442 2579 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 15:23:53.906513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.906455 2579 state_mem.go:35] "Initializing new in-memory state store" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951192 2579 manager.go:341] "Starting Device Plugin manager" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.951229 2579 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951242 2579 server.go:85] "Starting device plugin registration server" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951518 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951531 2579 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951636 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951714 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:53.951722 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.952187 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 15:23:53.953920 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:53.952219 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.024360 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.024276 2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 15:23:54.025694 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.025679 2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 15:23:54.025743 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.025708 2579 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 15:23:54.025743 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.025735 2579 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 15:23:54.025814 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.025750 2579 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 15:23:54.025814 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.025801 2579 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 15:23:54.029532 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.029512 2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:54.051634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.051608 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:54.053370 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.053351 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:54.053473 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.053386 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:54.053473 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.053402 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:54.053473 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.053433 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.067113 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.067094 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.067188 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.067118 2579 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-151.ec2.internal\": node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.107974 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.107950 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.126766 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.126740 2579 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal"] Jun 02 15:23:54.126877 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.126821 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:54.127808 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.127792 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:54.127898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.127825 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:54.127898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.127840 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:54.129271 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.129256 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:54.129440 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.129424 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.129488 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.129456 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:54.130032 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.130015 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:54.130091 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.130023 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:54.130091 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.130068 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:54.130091 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.130078 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:54.130230 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.130049 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:54.130230 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.130147 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:54.131163 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.131147 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.131249 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.131173 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:54.131858 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.131842 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:54.131858 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.131869 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:54.131996 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.131879 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:54.160280 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.160259 2579 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-151.ec2.internal\" not found" node="ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.164550 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.164531 2579 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-151.ec2.internal\" not found" node="ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.187743 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.187722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d02c33b090a63ef4c2fbc692f191012f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal\" (UID: \"d02c33b090a63ef4c2fbc692f191012f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.187831 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.187750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d02c33b090a63ef4c2fbc692f191012f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal\" (UID: \"d02c33b090a63ef4c2fbc692f191012f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.187831 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.187771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c2fdabb8b5f7451ee10e0409d68ce8b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-151.ec2.internal\" (UID: \"8c2fdabb8b5f7451ee10e0409d68ce8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.208625 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.208605 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.288294 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.288217 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d02c33b090a63ef4c2fbc692f191012f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal\" (UID: \"d02c33b090a63ef4c2fbc692f191012f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.288294 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.288261 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d02c33b090a63ef4c2fbc692f191012f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal\" (UID: \"d02c33b090a63ef4c2fbc692f191012f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.288294 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.288281 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c2fdabb8b5f7451ee10e0409d68ce8b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-151.ec2.internal\" (UID: \"8c2fdabb8b5f7451ee10e0409d68ce8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.288492 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.288318 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c2fdabb8b5f7451ee10e0409d68ce8b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-151.ec2.internal\" (UID: \"8c2fdabb8b5f7451ee10e0409d68ce8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.288492 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.288325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d02c33b090a63ef4c2fbc692f191012f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal\" (UID: \"d02c33b090a63ef4c2fbc692f191012f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.288492 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.288330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d02c33b090a63ef4c2fbc692f191012f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal\" (UID: \"d02c33b090a63ef4c2fbc692f191012f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.308809 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.308787 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.409144 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.409119 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.463538 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.463505 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.468279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.468249 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" Jun 02 15:23:54.509351 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.509315 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.609824 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.609763 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.710319 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.710276 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.777606 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.777557 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 15:23:54.778212 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.777697 2579 request.go:1360] "Unexpected error when reading response body" err="read tcp 10.0.141.151:60208->52.6.57.185:6443: use of closed network connection" Jun 02 15:23:54.778212 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.777707 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:23:54.778212 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.777720 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:23:54.778212 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.777760 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.141.151:60208->52.6.57.185:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:23:54.810357 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.810329 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.885019 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.884985 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 15:23:54.890740 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.890690 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 15:18:53 +0000 UTC" deadline="2028-02-25 10:07:10.223367306 +0000 UTC" Jun 02 15:23:54.890740 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.890735 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15186h43m15.332635951s" Jun 02 15:23:54.911343 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:54.911322 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:54.918776 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.918755 2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:23:54.960870 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:54.960838 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02c33b090a63ef4c2fbc692f191012f.slice/crio-e611cf0bc01b25b071ed20f13aefaa1054a3c60cd62796a58183f2cd9121623e WatchSource:0}: Error finding container e611cf0bc01b25b071ed20f13aefaa1054a3c60cd62796a58183f2cd9121623e: Status 404 returned error can't find the container with id e611cf0bc01b25b071ed20f13aefaa1054a3c60cd62796a58183f2cd9121623e Jun 02 15:23:54.964791 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.964774 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:23:54.970243 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:54.970219 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2fdabb8b5f7451ee10e0409d68ce8b.slice/crio-dfe5dfca048eba02a7b8c633a73b5e7f1a71ef8ccec5abf56af689cebab21a88 WatchSource:0}: Error finding container dfe5dfca048eba02a7b8c633a73b5e7f1a71ef8ccec5abf56af689cebab21a88: Status 404 returned error can't find the container with id dfe5dfca048eba02a7b8c633a73b5e7f1a71ef8ccec5abf56af689cebab21a88 Jun 02 15:23:54.980922 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.980905 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8lp29" Jun 02 15:23:54.994071 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:54.994051 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8lp29" Jun 02 15:23:55.012149 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:55.012127 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:55.028963 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.028928 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" event={"ID":"d02c33b090a63ef4c2fbc692f191012f","Type":"ContainerStarted","Data":"e611cf0bc01b25b071ed20f13aefaa1054a3c60cd62796a58183f2cd9121623e"} Jun 02 15:23:55.029892 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.029872 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" event={"ID":"8c2fdabb8b5f7451ee10e0409d68ce8b","Type":"ContainerStarted","Data":"dfe5dfca048eba02a7b8c633a73b5e7f1a71ef8ccec5abf56af689cebab21a88"} Jun 02 15:23:55.112359 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:55.112332 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:55.212872 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:55.212803 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:55.313484 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:55.313445 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-151.ec2.internal\" not found" Jun 02 15:23:55.404051 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.404022 2579 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:55.486847 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.486764 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" Jun 02 15:23:55.506252 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.506214 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:23:55.508190 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.508164 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" Jun 02 15:23:55.538201 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.538176 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:23:55.726474 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.726448 2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:55.857143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.857068 2579 apiserver.go:52] "Watching apiserver" Jun 02 15:23:55.869083 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.869057 2579 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 15:23:55.871237 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.870016 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-rjhgd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal","openshift-multus/multus-additional-cni-plugins-j7jh4","openshift-multus/multus-rn2tn","openshift-multus/network-metrics-daemon-45929","openshift-ovn-kubernetes/ovnkube-node-6wlqs","kube-system/konnectivity-agent-gnms9","kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt","openshift-dns/node-resolver-pdsnj","openshift-image-registry/node-ca-2n8tv","openshift-network-diagnostics/network-check-target-qm7m9","openshift-network-operator/iptables-alerter-h8r8z"] Jun 02 15:23:55.872164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.871890 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:55.875443 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.874931 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.875443 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.875122 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.876177 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.876153 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:55.876283 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:55.876233 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:23:55.877072 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.877050 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 15:23:55.877226 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.877210 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 15:23:55.877566 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.877549 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.878875 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.878848 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.880773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.880228 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.880773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.880279 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.880773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.880476 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 15:23:55.882264 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.881680 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.882264 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.881824 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:55.882264 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.882160 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bz98q\"" Jun 02 15:23:55.884696 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.884673 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:55.884804 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.884780 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:55.884913 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:55.884838 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:23:55.885986 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.885961 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:55.887633 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.886950 2579 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 15:23:55.892159 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.892141 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 15:23:55.892363 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.892347 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 15:23:55.892363 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.892358 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.892585 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.892556 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 15:23:55.892644 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.892599 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 15:23:55.892772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.892759 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 15:23:55.893357 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.893206 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.893357 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.893206 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.893839 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.893664 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.893839 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.893688 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 15:23:55.895855 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.895840 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.896046 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.896033 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6rr5r\"" Jun 02 15:23:55.896205 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.896192 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.896437 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.896422 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.896801 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.896718 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.897055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.896915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-run-netns\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.896968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.897055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-os-release\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.897055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-daemon-config\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.897055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-env-overrides\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovnkube-script-lib\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-run\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbr9\" (UniqueName: \"kubernetes.io/projected/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-kube-api-access-wzbr9\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-systemd-units\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-systemd\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f26d3c19-7974-4fb8-b46e-0430679cf60e-tmp\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.897257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47e08586-830a-4ff9-bb79-0492deb6c46c-konnectivity-ca\") pod \"konnectivity-agent-gnms9\" (UID: \"47e08586-830a-4ff9-bb79-0492deb6c46c\") " pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-systemd\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-node-log\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovnkube-config\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysctl-d\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-sys-fs\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9plv\" (UniqueName: \"kubernetes.io/projected/03565e0a-bb85-459f-8a11-65d33ab6d886-kube-api-access-f9plv\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-cnibin\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-etc-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-modprobe-d\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-host\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzq2m\" (UniqueName: \"kubernetes.io/projected/4d4b7569-305a-485c-ab54-de6f784e0c5b-kube-api-access-fzq2m\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47e08586-830a-4ff9-bb79-0492deb6c46c-agent-certs\") pod \"konnectivity-agent-gnms9\" (UID: \"47e08586-830a-4ff9-bb79-0492deb6c46c\") " pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/711e6b50-231c-431e-9b45-c0bb22e42a15-cni-binary-copy\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.897643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-k8s-cni-cncf-io\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d600b7e7-6b95-4a6f-b662-c9f0f117119c-host\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03565e0a-bb85-459f-8a11-65d33ab6d886-hosts-file\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-ovn\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovn-node-metrics-cert\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysconfig\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-sys\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-var-lib-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d600b7e7-6b95-4a6f-b662-c9f0f117119c-serviceca\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-iptables-alerter-script\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-cni-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp6h7\" (UniqueName: \"kubernetes.io/projected/711e6b50-231c-431e-9b45-c0bb22e42a15-kube-api-access-fp6h7\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-kubelet\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-tuned\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.898234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-cni-bin\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.897965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-kubelet\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-slash\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczl5\" (UniqueName: \"kubernetes.io/projected/f26d3c19-7974-4fb8-b46e-0430679cf60e-kube-api-access-kczl5\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-device-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-multus-certs\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-socket-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-system-cni-dir\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6bs\" (UniqueName: \"kubernetes.io/projected/4755447f-3fef-4dc6-b289-e1f10e3da9cb-kube-api-access-4x6bs\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-netns\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-hostroot\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-etc-kubernetes\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlvnb\" (UniqueName: \"kubernetes.io/projected/083a58df-dc26-4e68-b6b7-0b823ff0a87f-kube-api-access-mlvnb\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vct\" (UniqueName: \"kubernetes.io/projected/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-kube-api-access-j7vct\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.898882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-lib-modules\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65bpc\" (UniqueName: \"kubernetes.io/projected/d600b7e7-6b95-4a6f-b662-c9f0f117119c-kube-api-access-65bpc\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-os-release\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-system-cni-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-cni-multus\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-cni-bin\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-cni-netd\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-var-lib-kubelet\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03565e0a-bb85-459f-8a11-65d33ab6d886-tmp-dir\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysctl-conf\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-registration-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-kubernetes\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-socket-dir-parent\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-conf-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.899528 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-log-socket\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cnibin\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-host-slash\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898779 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sw44v\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.898973 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zlk47\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.899139 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.899287 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.899803 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.899983 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lh2bj\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900004 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900131 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 15:23:55.900279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900181 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8f7hx\"" Jun 02 15:23:55.900793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900300 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wbvgz\"" Jun 02 15:23:55.900793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900343 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-htrx7\"" Jun 02 15:23:55.900793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900587 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.900793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900622 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rm728\"" Jun 02 15:23:55.900793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.900739 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 15:23:55.901153 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.901135 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 15:23:55.995459 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.995420 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:18:54 +0000 UTC" deadline="2028-01-29 19:20:05.841760954 +0000 UTC" Jun 02 15:23:55.995459 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.995449 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14547h56m9.846314826s" Jun 02 15:23:55.999115 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999088 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-env-overrides\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999219 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999130 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovnkube-script-lib\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999219 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999160 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-run\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999219 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999187 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbr9\" (UniqueName: \"kubernetes.io/projected/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-kube-api-access-wzbr9\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:55.999219 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999211 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-systemd-units\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999235 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-systemd\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-run\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999289 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f26d3c19-7974-4fb8-b46e-0430679cf60e-tmp\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999314 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47e08586-830a-4ff9-bb79-0492deb6c46c-konnectivity-ca\") pod \"konnectivity-agent-gnms9\" (UID: \"47e08586-830a-4ff9-bb79-0492deb6c46c\") " pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-systemd-units\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999339 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-systemd\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999365 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-node-log\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999390 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999418 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovnkube-config\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999442 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysctl-d\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999467 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-sys-fs\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999491 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9plv\" (UniqueName: \"kubernetes.io/projected/03565e0a-bb85-459f-8a11-65d33ab6d886-kube-api-access-f9plv\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999515 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-cnibin\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999540 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-etc-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999564 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-modprobe-d\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999566 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-env-overrides\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999607 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-host\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999649 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzq2m\" (UniqueName: \"kubernetes.io/projected/4d4b7569-305a-485c-ab54-de6f784e0c5b-kube-api-access-fzq2m\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-host\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:55.999674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999674 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999695 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47e08586-830a-4ff9-bb79-0492deb6c46c-agent-certs\") pod \"konnectivity-agent-gnms9\" (UID: \"47e08586-830a-4ff9-bb79-0492deb6c46c\") " pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999717 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/711e6b50-231c-431e-9b45-c0bb22e42a15-cni-binary-copy\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999742 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-k8s-cni-cncf-io\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999766 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d600b7e7-6b95-4a6f-b662-c9f0f117119c-host\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999783 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03565e0a-bb85-459f-8a11-65d33ab6d886-hosts-file\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999802 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-ovn\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999827 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovn-node-metrics-cert\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999854 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysconfig\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999871 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-sys\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999886 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999901 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-var-lib-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999921 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999942 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d600b7e7-6b95-4a6f-b662-c9f0f117119c-serviceca\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999948 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000103 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovnkube-script-lib\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-systemd\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovnkube-config\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-node-log\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000331 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-cnibin\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000336 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysctl-d\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-sys-fs\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-etc-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000468 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-modprobe-d\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03565e0a-bb85-459f-8a11-65d33ab6d886-hosts-file\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000600 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-iptables-alerter-script\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47e08586-830a-4ff9-bb79-0492deb6c46c-konnectivity-ca\") pod \"konnectivity-agent-gnms9\" (UID: \"47e08586-830a-4ff9-bb79-0492deb6c46c\") " pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-sys\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000667 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-var-lib-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-systemd\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000708 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysconfig\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000742 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-ovn\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d600b7e7-6b95-4a6f-b662-c9f0f117119c-host\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-run-openvswitch\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.000939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000825 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000841 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-k8s-cni-cncf-io\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:55.999958 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-iptables-alerter-script\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000978 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-cni-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.000996 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp6h7\" (UniqueName: \"kubernetes.io/projected/711e6b50-231c-431e-9b45-c0bb22e42a15-kube-api-access-fp6h7\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001023 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-kubelet\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001084 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-tuned\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001109 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001133 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-cni-bin\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001162 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-kubelet\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001186 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-slash\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001235 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kczl5\" (UniqueName: \"kubernetes.io/projected/f26d3c19-7974-4fb8-b46e-0430679cf60e-kube-api-access-kczl5\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-kubelet\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001292 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-cni-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001276 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-device-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-kubelet\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.001768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001448 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-multus-certs\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/711e6b50-231c-431e-9b45-c0bb22e42a15-cni-binary-copy\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001475 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-socket-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001502 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001533 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-system-cni-dir\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001592 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6bs\" (UniqueName: \"kubernetes.io/projected/4755447f-3fef-4dc6-b289-e1f10e3da9cb-kube-api-access-4x6bs\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001620 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-netns\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001646 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-hostroot\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001672 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-etc-kubernetes\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001699 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlvnb\" (UniqueName: \"kubernetes.io/projected/083a58df-dc26-4e68-b6b7-0b823ff0a87f-kube-api-access-mlvnb\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-slash\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001728 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001756 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vct\" (UniqueName: \"kubernetes.io/projected/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-kube-api-access-j7vct\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001773 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-device-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001780 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-lib-modules\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001807 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65bpc\" (UniqueName: \"kubernetes.io/projected/d600b7e7-6b95-4a6f-b662-c9f0f117119c-kube-api-access-65bpc\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001815 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-multus-certs\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.002524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001838 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-os-release\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001865 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-system-cni-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001890 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-cni-multus\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-socket-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001916 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-cni-bin\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001954 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-cni-netd\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-cni-bin\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001979 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-var-lib-kubelet\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002005 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03565e0a-bb85-459f-8a11-65d33ab6d886-tmp-dir\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002032 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002060 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysctl-conf\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002088 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-registration-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-cni-bin\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-system-cni-dir\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002112 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-kubernetes\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.003303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002139 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002165 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-socket-dir-parent\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002192 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-conf-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002195 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-lib-modules\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002237 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-log-socket\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-system-cni-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-os-release\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002269 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cnibin\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-var-lib-cni-multus\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cnibin\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002309 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-host-slash\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d4b7569-305a-485c-ab54-de6f784e0c5b-registration-dir\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002336 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-run-netns\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-kubernetes\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-cni-netd\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002363 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-host-run-netns\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002392 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-os-release\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.004300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002402 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-var-lib-kubelet\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002430 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-daemon-config\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-os-release\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002459 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-host-run-netns\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.001235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d600b7e7-6b95-4a6f-b662-c9f0f117119c-serviceca\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03565e0a-bb85-459f-8a11-65d33ab6d886-tmp-dir\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-conf-dir\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002747 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-socket-dir-parent\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-log-socket\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002870 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-hostroot\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.002902 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/711e6b50-231c-431e-9b45-c0bb22e42a15-etc-kubernetes\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.002978 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.003074 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:23:56.503026981 +0000 UTC m=+3.108719676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/711e6b50-231c-431e-9b45-c0bb22e42a15-multus-daemon-config\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-host-slash\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:56.005164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.005768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4755447f-3fef-4dc6-b289-e1f10e3da9cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.005768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-sysctl-conf\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.005768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003783 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f26d3c19-7974-4fb8-b46e-0430679cf60e-etc-tuned\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.005768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003829 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f26d3c19-7974-4fb8-b46e-0430679cf60e-tmp\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.005768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.003916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-ovn-node-metrics-cert\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.005768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.005679 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47e08586-830a-4ff9-bb79-0492deb6c46c-agent-certs\") pod \"konnectivity-agent-gnms9\" (UID: \"47e08586-830a-4ff9-bb79-0492deb6c46c\") " pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:56.010474 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.010450 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbr9\" (UniqueName: \"kubernetes.io/projected/1b0cb9b0-a962-4cbe-8723-ef1fa5559063-kube-api-access-wzbr9\") pod \"iptables-alerter-h8r8z\" (UID: \"1b0cb9b0-a962-4cbe-8723-ef1fa5559063\") " pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:56.013392 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.013307 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:56.013392 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.013329 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:56.013392 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.013342 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:56.013606 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.013404 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:56.513384226 +0000 UTC m=+3.119076900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:56.013606 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.013465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp6h7\" (UniqueName: \"kubernetes.io/projected/711e6b50-231c-431e-9b45-c0bb22e42a15-kube-api-access-fp6h7\") pod \"multus-rn2tn\" (UID: \"711e6b50-231c-431e-9b45-c0bb22e42a15\") " pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.014062 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.014039 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65bpc\" (UniqueName: \"kubernetes.io/projected/d600b7e7-6b95-4a6f-b662-c9f0f117119c-kube-api-access-65bpc\") pod \"node-ca-2n8tv\" (UID: \"d600b7e7-6b95-4a6f-b662-c9f0f117119c\") " pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.015668 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.015648 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9plv\" (UniqueName: \"kubernetes.io/projected/03565e0a-bb85-459f-8a11-65d33ab6d886-kube-api-access-f9plv\") pod \"node-resolver-pdsnj\" (UID: \"03565e0a-bb85-459f-8a11-65d33ab6d886\") " pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:56.017051 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.017028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzq2m\" (UniqueName: \"kubernetes.io/projected/4d4b7569-305a-485c-ab54-de6f784e0c5b-kube-api-access-fzq2m\") pod \"aws-ebs-csi-driver-node-llhmt\" (UID: \"4d4b7569-305a-485c-ab54-de6f784e0c5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.018148 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.018127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlvnb\" (UniqueName: \"kubernetes.io/projected/083a58df-dc26-4e68-b6b7-0b823ff0a87f-kube-api-access-mlvnb\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:56.018295 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.018273 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6bs\" (UniqueName: \"kubernetes.io/projected/4755447f-3fef-4dc6-b289-e1f10e3da9cb-kube-api-access-4x6bs\") pod \"multus-additional-cni-plugins-j7jh4\" (UID: \"4755447f-3fef-4dc6-b289-e1f10e3da9cb\") " pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.019263 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.019246 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczl5\" (UniqueName: \"kubernetes.io/projected/f26d3c19-7974-4fb8-b46e-0430679cf60e-kube-api-access-kczl5\") pod \"tuned-rjhgd\" (UID: \"f26d3c19-7974-4fb8-b46e-0430679cf60e\") " pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.021447 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.021430 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vct\" (UniqueName: \"kubernetes.io/projected/80097dff-2cdf-4f4e-83d6-185ba6bb95e4-kube-api-access-j7vct\") pod \"ovnkube-node-6wlqs\" (UID: \"80097dff-2cdf-4f4e-83d6-185ba6bb95e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.183389 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.183320 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:23:56.190043 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.190021 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" Jun 02 15:23:56.202783 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.202763 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rn2tn" Jun 02 15:23:56.206144 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.206128 2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:56.209594 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.209557 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:23:56.217179 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.217162 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" Jun 02 15:23:56.224759 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.224735 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" Jun 02 15:23:56.232264 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.232247 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pdsnj" Jun 02 15:23:56.239727 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.239707 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2n8tv" Jun 02 15:23:56.247263 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.247239 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h8r8z" Jun 02 15:23:56.505192 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.505102 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:56.505334 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.505246 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:56.505334 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.505316 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:23:57.505300722 +0000 UTC m=+4.110993394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:56.606312 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.606274 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:56.606468 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.606434 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:56.606468 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.606448 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:56.606468 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.606457 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:56.606582 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:56.606508 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:57.606494742 +0000 UTC m=+4.212187436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:56.633987 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.633892 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd600b7e7_6b95_4a6f_b662_c9f0f117119c.slice/crio-efc1132f1289bcce53240b8f240de90d8cdb852f775328c165ae570aa3cbbc91 WatchSource:0}: Error finding container efc1132f1289bcce53240b8f240de90d8cdb852f775328c165ae570aa3cbbc91: Status 404 returned error can't find the container with id efc1132f1289bcce53240b8f240de90d8cdb852f775328c165ae570aa3cbbc91 Jun 02 15:23:56.636802 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.636780 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0cb9b0_a962_4cbe_8723_ef1fa5559063.slice/crio-630a572975ee5e2d4dd06b52e2249deb94148f8c319a6e8c432bb44e93c04500 WatchSource:0}: Error finding container 630a572975ee5e2d4dd06b52e2249deb94148f8c319a6e8c432bb44e93c04500: Status 404 returned error can't find the container with id 630a572975ee5e2d4dd06b52e2249deb94148f8c319a6e8c432bb44e93c04500 Jun 02 15:23:56.638244 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.638221 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03565e0a_bb85_459f_8a11_65d33ab6d886.slice/crio-0b1b3d52ce5365cff69b489676bf0fad3d2c5931c69ab2963c09d1f71ed3571e WatchSource:0}: Error finding container 0b1b3d52ce5365cff69b489676bf0fad3d2c5931c69ab2963c09d1f71ed3571e: Status 404 returned error can't find the container with id 0b1b3d52ce5365cff69b489676bf0fad3d2c5931c69ab2963c09d1f71ed3571e Jun 02 15:23:56.638801 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.638781 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711e6b50_231c_431e_9b45_c0bb22e42a15.slice/crio-258c9d4011a1c50a5418750cfb56024ca66dcf268c5983a681bef6b345bee6d2 WatchSource:0}: Error finding container 258c9d4011a1c50a5418750cfb56024ca66dcf268c5983a681bef6b345bee6d2: Status 404 returned error can't find the container with id 258c9d4011a1c50a5418750cfb56024ca66dcf268c5983a681bef6b345bee6d2 Jun 02 15:23:56.639879 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.639856 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e08586_830a_4ff9_bb79_0492deb6c46c.slice/crio-ad47063f2402fee57c819d669a2a3e34605a98a85ba076a3578a8b99675cfb69 WatchSource:0}: Error finding container ad47063f2402fee57c819d669a2a3e34605a98a85ba076a3578a8b99675cfb69: Status 404 returned error can't find the container with id ad47063f2402fee57c819d669a2a3e34605a98a85ba076a3578a8b99675cfb69 Jun 02 15:23:56.641035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.641014 2579 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:56.641850 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.641728 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80097dff_2cdf_4f4e_83d6_185ba6bb95e4.slice/crio-b5b61a424a5b5bffb79fb58c3923ccd938737467928fd0b6b5dbc3d008b997a9 WatchSource:0}: Error finding container b5b61a424a5b5bffb79fb58c3923ccd938737467928fd0b6b5dbc3d008b997a9: Status 404 returned error can't find the container with id b5b61a424a5b5bffb79fb58c3923ccd938737467928fd0b6b5dbc3d008b997a9 Jun 02 15:23:56.642389 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.642369 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26d3c19_7974_4fb8_b46e_0430679cf60e.slice/crio-4f320d14c50e0d1a118855dab87c214e807687b7f94b6b28717114bfb8147f25 WatchSource:0}: Error finding container 4f320d14c50e0d1a118855dab87c214e807687b7f94b6b28717114bfb8147f25: Status 404 returned error can't find the container with id 4f320d14c50e0d1a118855dab87c214e807687b7f94b6b28717114bfb8147f25 Jun 02 15:23:56.645077 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.645051 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4b7569_305a_485c_ab54_de6f784e0c5b.slice/crio-862f4e49225a5c74de6dd3ac76f7dd43f18df6cbbe28be3915413d5908305530 WatchSource:0}: Error finding container 862f4e49225a5c74de6dd3ac76f7dd43f18df6cbbe28be3915413d5908305530: Status 404 returned error can't find the container with id 862f4e49225a5c74de6dd3ac76f7dd43f18df6cbbe28be3915413d5908305530 Jun 02 15:23:56.645399 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:23:56.645377 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4755447f_3fef_4dc6_b289_e1f10e3da9cb.slice/crio-9b4a9b85c29c69e287a94ca626823e1f249e6ea33621662e1e1db99f84e7cb11 WatchSource:0}: Error finding container 9b4a9b85c29c69e287a94ca626823e1f249e6ea33621662e1e1db99f84e7cb11: Status 404 returned error can't find the container with id 9b4a9b85c29c69e287a94ca626823e1f249e6ea33621662e1e1db99f84e7cb11 Jun 02 15:23:56.995990 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.995738 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:18:54 +0000 UTC" deadline="2028-01-01 02:06:39.645728125 +0000 UTC" Jun 02 15:23:56.995990 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:56.995989 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13858h42m42.649745904s" Jun 02 15:23:57.034668 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.034625 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h8r8z" event={"ID":"1b0cb9b0-a962-4cbe-8723-ef1fa5559063","Type":"ContainerStarted","Data":"630a572975ee5e2d4dd06b52e2249deb94148f8c319a6e8c432bb44e93c04500"} Jun 02 15:23:57.036645 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.036615 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" event={"ID":"8c2fdabb8b5f7451ee10e0409d68ce8b","Type":"ContainerStarted","Data":"dcd11f263b07d2994c59a145df8eba8fe962ac5aafc3f42c12da129132355b18"} Jun 02 15:23:57.041994 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.041950 2579 generic.go:358] "Generic (PLEG): container finished" podID="d02c33b090a63ef4c2fbc692f191012f" containerID="de7ff72e9a05457f2fd912d6e790759537164878cf3ee3a92a3fe8fd0bbdc5ce" exitCode=0 Jun 02 15:23:57.042114 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.042049 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" event={"ID":"d02c33b090a63ef4c2fbc692f191012f","Type":"ContainerDied","Data":"de7ff72e9a05457f2fd912d6e790759537164878cf3ee3a92a3fe8fd0bbdc5ce"} Jun 02 15:23:57.044013 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.043973 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerStarted","Data":"9b4a9b85c29c69e287a94ca626823e1f249e6ea33621662e1e1db99f84e7cb11"} Jun 02 15:23:57.045088 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.045060 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" event={"ID":"f26d3c19-7974-4fb8-b46e-0430679cf60e","Type":"ContainerStarted","Data":"4f320d14c50e0d1a118855dab87c214e807687b7f94b6b28717114bfb8147f25"} Jun 02 15:23:57.047173 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.047142 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"b5b61a424a5b5bffb79fb58c3923ccd938737467928fd0b6b5dbc3d008b997a9"} Jun 02 15:23:57.049775 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.049721 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2n8tv" event={"ID":"d600b7e7-6b95-4a6f-b662-c9f0f117119c","Type":"ContainerStarted","Data":"efc1132f1289bcce53240b8f240de90d8cdb852f775328c165ae570aa3cbbc91"} Jun 02 15:23:57.053168 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.053125 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" event={"ID":"4d4b7569-305a-485c-ab54-de6f784e0c5b","Type":"ContainerStarted","Data":"862f4e49225a5c74de6dd3ac76f7dd43f18df6cbbe28be3915413d5908305530"} Jun 02 15:23:57.054759 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.054708 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnms9" event={"ID":"47e08586-830a-4ff9-bb79-0492deb6c46c","Type":"ContainerStarted","Data":"ad47063f2402fee57c819d669a2a3e34605a98a85ba076a3578a8b99675cfb69"} Jun 02 15:23:57.056655 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.056609 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rn2tn" event={"ID":"711e6b50-231c-431e-9b45-c0bb22e42a15","Type":"ContainerStarted","Data":"258c9d4011a1c50a5418750cfb56024ca66dcf268c5983a681bef6b345bee6d2"} Jun 02 15:23:57.060817 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.060152 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pdsnj" event={"ID":"03565e0a-bb85-459f-8a11-65d33ab6d886","Type":"ContainerStarted","Data":"0b1b3d52ce5365cff69b489676bf0fad3d2c5931c69ab2963c09d1f71ed3571e"} Jun 02 15:23:57.070696 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.070532 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-151.ec2.internal" podStartSLOduration=2.070518756 podStartE2EDuration="2.070518756s" podCreationTimestamp="2026-06-02 15:23:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:23:57.052922415 +0000 UTC m=+3.658615110" watchObservedRunningTime="2026-06-02 15:23:57.070518756 +0000 UTC m=+3.676211450" Jun 02 15:23:57.515081 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.514456 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:57.515081 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:57.514637 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:57.515081 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:57.514703 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:23:59.514684822 +0000 UTC m=+6.120377499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:57.616665 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:57.615565 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:57.616665 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:57.616187 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:57.616665 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:57.616208 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:57.616665 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:57.616221 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:57.616665 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:57.616280 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:59.616261682 +0000 UTC m=+6.221954378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:58.026992 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:58.026243 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:58.026992 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:58.026376 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:23:58.026992 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:58.026846 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:58.026992 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:58.026948 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:23:58.083450 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:58.083417 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" event={"ID":"d02c33b090a63ef4c2fbc692f191012f","Type":"ContainerStarted","Data":"4172fc965a30863d25fc236c50a3c12599b4fa355a6901de856075a7d8cf2d11"} Jun 02 15:23:59.531553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:59.531512 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:23:59.532101 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:59.531674 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:59.532101 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:59.531736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:03.531718151 +0000 UTC m=+10.137410843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:59.632698 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:23:59.632660 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:23:59.632966 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:59.632829 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:59.632966 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:59.632851 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:59.632966 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:59.632862 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:59.632966 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:23:59.632920 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:03.632903373 +0000 UTC m=+10.238596058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:00.026233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:00.026145 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:00.026408 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:00.026335 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:00.028649 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:00.028620 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:00.028775 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:00.028756 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:02.027059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:02.026720 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:02.027059 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:02.026861 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:02.027620 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:02.027312 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:02.027620 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:02.027412 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:03.564375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:03.564247 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:03.564923 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:03.564454 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:03.564923 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:03.564553 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:11.5645073 +0000 UTC m=+18.170199972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:03.665383 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:03.665343 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:03.665598 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:03.665526 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:24:03.665598 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:03.665546 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:24:03.665598 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:03.665561 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:03.665765 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:03.665639 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:11.665619198 +0000 UTC m=+18.271311870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:04.027174 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:04.027087 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:04.027315 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:04.027225 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:04.027315 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:04.027273 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:04.027401 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:04.027386 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:06.026861 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:06.026817 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:06.026861 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:06.026874 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:06.027350 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:06.026944 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:06.027350 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:06.027085 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:08.026745 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:08.026705 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:08.027238 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:08.026867 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:08.027238 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:08.026990 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:08.027238 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:08.026867 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:10.026642 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:10.026598 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:10.027180 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:10.026651 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:10.027180 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:10.026727 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:10.027180 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:10.026882 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:11.622807 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:11.622765 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:11.623258 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:11.622949 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:11.623258 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:11.623013 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:27.622996431 +0000 UTC m=+34.228689102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:11.724083 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:11.724043 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:11.724281 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:11.724218 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:24:11.724281 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:11.724235 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:24:11.724281 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:11.724244 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:11.724424 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:11.724301 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:27.724281775 +0000 UTC m=+34.329974447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:12.026679 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:12.026595 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:12.026976 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:12.026722 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:12.026976 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:12.026778 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:12.026976 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:12.026883 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:14.026787 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:14.026723 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:14.027273 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:14.026821 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:14.027273 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:14.026923 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:14.027442 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:14.027415 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:16.026772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.026234 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:16.027489 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.026244 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:16.027489 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:16.026833 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:16.027489 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:16.026876 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:16.120171 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.120128 2579 generic.go:358] "Generic (PLEG): container finished" podID="4755447f-3fef-4dc6-b289-e1f10e3da9cb" containerID="9d6a18254d622eed2525f42a536f4a14779792f175ae277234ba81e5942d7665" exitCode=0 Jun 02 15:24:16.120353 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.120227 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerDied","Data":"9d6a18254d622eed2525f42a536f4a14779792f175ae277234ba81e5942d7665"} Jun 02 15:24:16.122426 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.122398 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" event={"ID":"f26d3c19-7974-4fb8-b46e-0430679cf60e","Type":"ContainerStarted","Data":"446a8b39866f95407ab10ca005dea0f3cb7d0d5df0a6a18953b60faa3c2b83a8"} Jun 02 15:24:16.125246 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.125227 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"831b5cdefe68858a66b77e78931103a1eead5d04c520da2c1dac53d2ab5e32aa"} Jun 02 15:24:16.125246 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.125253 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"69a4736b2580d04bd570d9cf7ee5bf0833011081e068bb8623127e7efb7c5931"} Jun 02 15:24:16.125419 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.125266 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"b387ba5feb767007dda3c9e20ae97e4d0ba6644df79c6c3ec56727885b67ee2a"} Jun 02 15:24:16.125419 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.125276 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"f4ae83c5d9e1f8bb51c56946dd02586c869d9d1ab8b153228c68bce8043580c3"} Jun 02 15:24:16.125419 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.125288 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"b11ee6aeb164fb1269c16c8c6e41759f9406b36e93afa760b2bd3a333b979cf5"} Jun 02 15:24:16.125419 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.125300 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"d29eb44fb237ca4cfab1eb7b29b8582276dbf28a3b4f36a83bec7c7ac0d9f25a"} Jun 02 15:24:16.126618 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.126565 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2n8tv" event={"ID":"d600b7e7-6b95-4a6f-b662-c9f0f117119c","Type":"ContainerStarted","Data":"d801d53efe14019f556e3231ce833159c57d74b6f65f08dd142fc4037bb2a227"} Jun 02 15:24:16.127989 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.127965 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" event={"ID":"4d4b7569-305a-485c-ab54-de6f784e0c5b","Type":"ContainerStarted","Data":"fda4f0c72d8413b5f60790b2ac011202a551cc5c170e252f860ff5ad7acfddd1"} Jun 02 15:24:16.129231 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.129210 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnms9" event={"ID":"47e08586-830a-4ff9-bb79-0492deb6c46c","Type":"ContainerStarted","Data":"94c7e163ceee5a953b862b6f566934399e4335d6b030c95268fd6f01b051c26f"} Jun 02 15:24:16.130672 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.130645 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rn2tn" event={"ID":"711e6b50-231c-431e-9b45-c0bb22e42a15","Type":"ContainerStarted","Data":"1ae1f726eb74cf259754d9239f6b982dbe178f03eb241edba1550597d20e3c8f"} Jun 02 15:24:16.131898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.131877 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pdsnj" event={"ID":"03565e0a-bb85-459f-8a11-65d33ab6d886","Type":"ContainerStarted","Data":"141775fd706ebfce8b661def99b476c398e2354808e0f5906f79a8b245eb27aa"} Jun 02 15:24:16.166714 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.166662 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-151.ec2.internal" podStartSLOduration=21.166642444 podStartE2EDuration="21.166642444s" podCreationTimestamp="2026-06-02 15:23:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:23:58.107072292 +0000 UTC m=+4.712764987" watchObservedRunningTime="2026-06-02 15:24:16.166642444 +0000 UTC m=+22.772335141" Jun 02 15:24:16.274935 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.274884 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2n8tv" podStartSLOduration=3.698271085 podStartE2EDuration="22.274870112s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.635797811 +0000 UTC m=+3.241490485" lastFinishedPulling="2026-06-02 15:24:15.21239684 +0000 UTC m=+21.818089512" observedRunningTime="2026-06-02 15:24:16.217991398 +0000 UTC m=+22.823684092" watchObservedRunningTime="2026-06-02 15:24:16.274870112 +0000 UTC m=+22.880562805" Jun 02 15:24:16.275432 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.275401 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gnms9" podStartSLOduration=12.065049607 podStartE2EDuration="22.27539277s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.642215768 +0000 UTC m=+3.247908443" lastFinishedPulling="2026-06-02 15:24:06.852558923 +0000 UTC m=+13.458251606" observedRunningTime="2026-06-02 15:24:16.27453723 +0000 UTC m=+22.880229924" watchObservedRunningTime="2026-06-02 15:24:16.27539277 +0000 UTC m=+22.881085463" Jun 02 15:24:16.388683 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.388558 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pdsnj" podStartSLOduration=4.234594353 podStartE2EDuration="22.388539654s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.639798497 +0000 UTC m=+3.245491169" lastFinishedPulling="2026-06-02 15:24:14.793743798 +0000 UTC m=+21.399436470" observedRunningTime="2026-06-02 15:24:16.326621959 +0000 UTC m=+22.932314657" watchObservedRunningTime="2026-06-02 15:24:16.388539654 +0000 UTC m=+22.994232349" Jun 02 15:24:16.429236 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.429185 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rjhgd" podStartSLOduration=3.860038286 podStartE2EDuration="22.429172424s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.644234086 +0000 UTC m=+3.249926768" lastFinishedPulling="2026-06-02 15:24:15.213368234 +0000 UTC m=+21.819060906" observedRunningTime="2026-06-02 15:24:16.429044364 +0000 UTC m=+23.034737059" watchObservedRunningTime="2026-06-02 15:24:16.429172424 +0000 UTC m=+23.034865134" Jun 02 15:24:16.429445 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.429417 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rn2tn" podStartSLOduration=3.839916294 podStartE2EDuration="22.429409953s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.641121503 +0000 UTC m=+3.246814189" lastFinishedPulling="2026-06-02 15:24:15.230615163 +0000 UTC m=+21.836307848" observedRunningTime="2026-06-02 15:24:16.389353591 +0000 UTC m=+22.995046285" watchObservedRunningTime="2026-06-02 15:24:16.429409953 +0000 UTC m=+23.035102647" Jun 02 15:24:16.587473 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.587450 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 15:24:16.963437 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.963331 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T15:24:16.587469442Z","UUID":"d4a4b728-73b6-4cc1-9ade-315b7ee7909b","Handler":null,"Name":"","Endpoint":""} Jun 02 15:24:16.965342 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.965319 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 15:24:16.965460 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:16.965355 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 15:24:17.134978 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:17.134942 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h8r8z" event={"ID":"1b0cb9b0-a962-4cbe-8723-ef1fa5559063","Type":"ContainerStarted","Data":"588fece702c2fdadc0f887abdd16348955215165a794ad1d01726bc71e630117"} Jun 02 15:24:17.137151 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:17.137117 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" event={"ID":"4d4b7569-305a-485c-ab54-de6f784e0c5b","Type":"ContainerStarted","Data":"58d393ffb313d2e48511e6f4c53a7f48163a56ccb02690fdf5518a75ba9df4e1"} Jun 02 15:24:18.026973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.026761 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:18.027145 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.026829 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:18.027145 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:18.027056 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:18.027213 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:18.027137 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:18.141200 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.141114 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" event={"ID":"4d4b7569-305a-485c-ab54-de6f784e0c5b","Type":"ContainerStarted","Data":"1afbfa14cc9267352e65a610156735d09b682d5801f87d14eb4188087f4e552a"} Jun 02 15:24:18.144410 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.144383 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"2623c2a4389a9649e639f27987e7a31f824e52f58418ec22fcd2154be0bea865"} Jun 02 15:24:18.191352 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.191300 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llhmt" podStartSLOduration=3.411749793 podStartE2EDuration="24.1912852s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.647346758 +0000 UTC m=+3.253039434" lastFinishedPulling="2026-06-02 15:24:17.426882169 +0000 UTC m=+24.032574841" observedRunningTime="2026-06-02 15:24:18.189131284 +0000 UTC m=+24.794823995" watchObservedRunningTime="2026-06-02 15:24:18.1912852 +0000 UTC m=+24.796977893" Jun 02 15:24:18.191526 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.191479 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h8r8z" podStartSLOduration=5.6386090509999995 podStartE2EDuration="24.191475484s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.638392755 +0000 UTC m=+3.244085432" lastFinishedPulling="2026-06-02 15:24:15.191259178 +0000 UTC m=+21.796951865" observedRunningTime="2026-06-02 15:24:17.176461869 +0000 UTC m=+23.782154564" watchObservedRunningTime="2026-06-02 15:24:18.191475484 +0000 UTC m=+24.797168178" Jun 02 15:24:18.861267 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.861230 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:24:18.861998 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:18.861971 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:24:19.146224 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:19.146139 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:24:19.146827 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:19.146792 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gnms9" Jun 02 15:24:20.026309 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:20.026268 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:20.026478 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:20.026282 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:20.026478 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:20.026410 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:20.026626 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:20.026481 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:20.152020 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:20.151714 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" event={"ID":"80097dff-2cdf-4f4e-83d6-185ba6bb95e4","Type":"ContainerStarted","Data":"82cd9e0fd73f6704d38fa7ff8a7e5de85b44c7d4feb6c1f826db9fcb755a200c"} Jun 02 15:24:20.152728 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:20.152111 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:24:20.169862 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:20.169839 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:24:20.211784 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:20.211723 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" podStartSLOduration=7.580713876 podStartE2EDuration="26.211708264s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.643386355 +0000 UTC m=+3.249079028" lastFinishedPulling="2026-06-02 15:24:15.274380728 +0000 UTC m=+21.880073416" observedRunningTime="2026-06-02 15:24:20.209893862 +0000 UTC m=+26.815586566" watchObservedRunningTime="2026-06-02 15:24:20.211708264 +0000 UTC m=+26.817400957" Jun 02 15:24:21.153900 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:21.153867 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:24:21.154477 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:21.154453 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:24:21.175687 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:21.175657 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:24:22.026733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.026706 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:22.026867 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.026742 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:22.026867 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:22.026827 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:22.026992 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:22.026900 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:22.157727 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.157699 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerStarted","Data":"ef84d37d75337deb57b803bc0b92cc215ede7a7fe78a74eab73cab8cbd411993"} Jun 02 15:24:22.158069 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.157793 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:24:22.267647 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.267545 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45929"] Jun 02 15:24:22.267811 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.267696 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:22.267870 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:22.267814 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:22.276625 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.276599 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm7m9"] Jun 02 15:24:22.276778 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:22.276690 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:22.276838 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:22.276791 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:23.161388 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:23.161348 2579 generic.go:358] "Generic (PLEG): container finished" podID="4755447f-3fef-4dc6-b289-e1f10e3da9cb" containerID="ef84d37d75337deb57b803bc0b92cc215ede7a7fe78a74eab73cab8cbd411993" exitCode=0 Jun 02 15:24:23.161857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:23.161444 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerDied","Data":"ef84d37d75337deb57b803bc0b92cc215ede7a7fe78a74eab73cab8cbd411993"} Jun 02 15:24:23.161935 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:23.161921 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:24:24.027656 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:24.027462 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:24.027818 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:24.027539 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:24.027897 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:24.027834 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:24.027897 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:24.027721 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:25.166328 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:25.166287 2579 generic.go:358] "Generic (PLEG): container finished" podID="4755447f-3fef-4dc6-b289-e1f10e3da9cb" containerID="59f4c75747b5cfe7d151ec2b1f89794ec6dc3df94ce3f083aa7af77af7d2d89e" exitCode=0 Jun 02 15:24:25.167033 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:25.166349 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerDied","Data":"59f4c75747b5cfe7d151ec2b1f89794ec6dc3df94ce3f083aa7af77af7d2d89e"} Jun 02 15:24:25.293184 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:25.293146 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:24:25.293392 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:25.293377 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:24:25.312420 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:25.312380 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" podUID="80097dff-2cdf-4f4e-83d6-185ba6bb95e4" containerName="ovnkube-controller" probeResult="failure" output="" Jun 02 15:24:25.321145 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:25.321110 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" podUID="80097dff-2cdf-4f4e-83d6-185ba6bb95e4" containerName="ovnkube-controller" probeResult="failure" output="" Jun 02 15:24:26.026953 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:26.026916 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:26.027128 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:26.026916 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:26.027128 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:26.027031 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:26.027128 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:26.027102 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:27.172217 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:27.172186 2579 generic.go:358] "Generic (PLEG): container finished" podID="4755447f-3fef-4dc6-b289-e1f10e3da9cb" containerID="c7cd57fd20750e2f494cac7332bc5a7cbc9e55c8811e39736f270841a949b6d5" exitCode=0 Jun 02 15:24:27.172753 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:27.172236 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerDied","Data":"c7cd57fd20750e2f494cac7332bc5a7cbc9e55c8811e39736f270841a949b6d5"} Jun 02 15:24:27.640271 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:27.640234 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:27.640465 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:27.640364 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:27.640465 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:27.640419 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:59.640404817 +0000 UTC m=+66.246097490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:27.741379 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:27.741341 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:27.741520 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:27.741498 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:24:27.741520 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:27.741517 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:24:27.741630 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:27.741527 2579 projected.go:194] Error preparing data for projected volume kube-api-access-pwwmz for pod openshift-network-diagnostics/network-check-target-qm7m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:27.741630 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:27.741606 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz podName:659c3a78-ae6d-456e-9e93-1fb8313fe621 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:59.741587626 +0000 UTC m=+66.347280312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwwmz" (UniqueName: "kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz") pod "network-check-target-qm7m9" (UID: "659c3a78-ae6d-456e-9e93-1fb8313fe621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:28.026059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.025968 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:28.026238 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.025989 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:28.026238 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.026121 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:24:28.026238 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.026188 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm7m9" podUID="659c3a78-ae6d-456e-9e93-1fb8313fe621" Jun 02 15:24:28.176609 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.176560 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-151.ec2.internal" event="NodeReady" Jun 02 15:24:28.177204 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.176726 2579 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 15:24:28.258278 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.258233 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pwpvj"] Jun 02 15:24:28.280733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.279654 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tptbf"] Jun 02 15:24:28.280733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.279824 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.282986 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.282937 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqlt7\"" Jun 02 15:24:28.283937 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.283912 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 15:24:28.284035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.283920 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 15:24:28.300500 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.300473 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tptbf"] Jun 02 15:24:28.300500 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.300502 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwpvj"] Jun 02 15:24:28.300689 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.300614 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:28.303790 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.303763 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 15:24:28.304228 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.304082 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 15:24:28.304228 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.304151 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb47d\"" Jun 02 15:24:28.304228 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.304085 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 15:24:28.347070 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.347030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adec3c5a-94e4-4775-ba97-1573b0ab830e-tmp-dir\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.347230 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.347094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adec3c5a-94e4-4775-ba97-1573b0ab830e-config-volume\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.347230 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.347134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5nkd\" (UniqueName: \"kubernetes.io/projected/adec3c5a-94e4-4775-ba97-1573b0ab830e-kube-api-access-r5nkd\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.347230 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.347162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.448518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdw6d\" (UniqueName: \"kubernetes.io/projected/5b201605-4a24-4ba3-9d3d-89b580fd04e0-kube-api-access-bdw6d\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:28.448518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448521 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adec3c5a-94e4-4775-ba97-1573b0ab830e-tmp-dir\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.448733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448602 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adec3c5a-94e4-4775-ba97-1573b0ab830e-config-volume\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.448733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448655 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5nkd\" (UniqueName: \"kubernetes.io/projected/adec3c5a-94e4-4775-ba97-1573b0ab830e-kube-api-access-r5nkd\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.448733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448676 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.448733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:28.448857 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.448794 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:28.448857 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.448847 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:24:28.94883081 +0000 UTC m=+35.554523482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:24:28.448954 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.448933 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adec3c5a-94e4-4775-ba97-1573b0ab830e-tmp-dir\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.449090 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.449073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adec3c5a-94e4-4775-ba97-1573b0ab830e-config-volume\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.463924 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.463890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5nkd\" (UniqueName: \"kubernetes.io/projected/adec3c5a-94e4-4775-ba97-1573b0ab830e-kube-api-access-r5nkd\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.549699 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.549613 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdw6d\" (UniqueName: \"kubernetes.io/projected/5b201605-4a24-4ba3-9d3d-89b580fd04e0-kube-api-access-bdw6d\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:28.549852 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.549712 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:28.549852 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.549820 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:28.549930 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.549880 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:29.04986676 +0000 UTC m=+35.655559433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:24:28.568738 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.568708 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdw6d\" (UniqueName: \"kubernetes.io/projected/5b201605-4a24-4ba3-9d3d-89b580fd04e0-kube-api-access-bdw6d\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:28.952864 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:28.952803 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:28.953060 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.952967 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:28.953060 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:28.953037 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:24:29.95301684 +0000 UTC m=+36.558709514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:24:29.053587 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:29.053547 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:29.053765 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:29.053676 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:29.053765 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:29.053743 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:30.05372741 +0000 UTC m=+36.659420085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:24:29.959913 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:29.959872 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:29.960339 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:29.960028 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:29.960339 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:29.960094 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:24:31.960078049 +0000 UTC m=+38.565770722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:24:30.026347 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.026311 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:30.026601 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.026555 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:30.030541 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.030508 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:24:30.030678 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.030628 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8csp4\"" Jun 02 15:24:30.032295 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.032275 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hhkk\"" Jun 02 15:24:30.032791 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.032771 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:24:30.032898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.032791 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:24:30.060395 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:30.060366 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:30.060636 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:30.060523 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:30.060636 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:30.060611 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:32.060589831 +0000 UTC m=+38.666282525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:24:31.977040 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:31.976781 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:31.977422 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:31.976931 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:31.977422 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:31.977142 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:24:35.977117972 +0000 UTC m=+42.582810648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:24:32.077919 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:32.077882 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:32.078110 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:32.078030 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:32.078110 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:32.078096 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:36.078075647 +0000 UTC m=+42.683768336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:24:34.187428 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:34.187345 2579 generic.go:358] "Generic (PLEG): container finished" podID="4755447f-3fef-4dc6-b289-e1f10e3da9cb" containerID="f02aba65ae3834fa349c884bf664b9f31ec098daf2bf97edcb0a99e4518a9ec4" exitCode=0 Jun 02 15:24:34.187428 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:34.187408 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerDied","Data":"f02aba65ae3834fa349c884bf664b9f31ec098daf2bf97edcb0a99e4518a9ec4"} Jun 02 15:24:35.192057 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:35.192026 2579 generic.go:358] "Generic (PLEG): container finished" podID="4755447f-3fef-4dc6-b289-e1f10e3da9cb" containerID="50fbc5b5f3e6bd54a0430e388133f0b213a3792aa8d72b9fc6501759af54f953" exitCode=0 Jun 02 15:24:35.192467 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:35.192080 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerDied","Data":"50fbc5b5f3e6bd54a0430e388133f0b213a3792aa8d72b9fc6501759af54f953"} Jun 02 15:24:36.011931 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:36.011870 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:36.012132 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:36.012047 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:36.012132 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:36.012126 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:24:44.012106843 +0000 UTC m=+50.617799523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:24:36.112999 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:36.112936 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:36.113188 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:36.113085 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:36.113188 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:36.113144 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:44.113130879 +0000 UTC m=+50.718823552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:24:36.197225 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:36.197176 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" event={"ID":"4755447f-3fef-4dc6-b289-e1f10e3da9cb","Type":"ContainerStarted","Data":"d817fccd6821f42639fb080ffd95a7b969e49b1a9a6c4cb319b484cdf286f6a0"} Jun 02 15:24:36.228013 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:36.227963 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j7jh4" podStartSLOduration=5.227698957 podStartE2EDuration="42.227949252s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:23:56.647469765 +0000 UTC m=+3.253162440" lastFinishedPulling="2026-06-02 15:24:33.647720064 +0000 UTC m=+40.253412735" observedRunningTime="2026-06-02 15:24:36.226296735 +0000 UTC m=+42.831989420" watchObservedRunningTime="2026-06-02 15:24:36.227949252 +0000 UTC m=+42.833641946" Jun 02 15:24:44.069241 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:44.069197 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:24:44.069722 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:44.069339 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:44.069722 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:44.069401 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:25:00.069384446 +0000 UTC m=+66.675077118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:24:44.170069 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:44.170025 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:24:44.170222 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:44.170145 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:44.170222 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:44.170206 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:25:00.170192471 +0000 UTC m=+66.775885144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:24:55.323055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:55.323023 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlqs" Jun 02 15:24:59.682447 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:59.682411 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:24:59.686700 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:59.686677 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:24:59.693388 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:59.693369 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:24:59.693453 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:24:59.693441 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:26:03.693419737 +0000 UTC m=+130.299112409 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : secret "metrics-daemon-secret" not found Jun 02 15:24:59.783226 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:59.783194 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:24:59.786711 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:59.786694 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:24:59.797262 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:59.797242 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:24:59.808235 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:24:59.808205 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwwmz\" (UniqueName: \"kubernetes.io/projected/659c3a78-ae6d-456e-9e93-1fb8313fe621-kube-api-access-pwwmz\") pod \"network-check-target-qm7m9\" (UID: \"659c3a78-ae6d-456e-9e93-1fb8313fe621\") " pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:25:00.048186 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:00.048100 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hhkk\"" Jun 02 15:25:00.054851 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:00.054831 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:25:00.084973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:00.084931 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:25:00.085121 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:00.085068 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:25:00.085161 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:00.085139 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:25:32.085117444 +0000 UTC m=+98.690810115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:25:00.185836 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:00.185803 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:25:00.185999 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:00.185953 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:25:00.186040 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:00.186023 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:25:32.186005501 +0000 UTC m=+98.791698175 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:25:00.188959 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:00.188928 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm7m9"] Jun 02 15:25:00.193045 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:25:00.193015 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659c3a78_ae6d_456e_9e93_1fb8313fe621.slice/crio-3ca0604fee8679350db4410ccffd8ccfe3664fdb2e20877796d070042030b9cc WatchSource:0}: Error finding container 3ca0604fee8679350db4410ccffd8ccfe3664fdb2e20877796d070042030b9cc: Status 404 returned error can't find the container with id 3ca0604fee8679350db4410ccffd8ccfe3664fdb2e20877796d070042030b9cc Jun 02 15:25:00.243127 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:00.243083 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm7m9" event={"ID":"659c3a78-ae6d-456e-9e93-1fb8313fe621","Type":"ContainerStarted","Data":"3ca0604fee8679350db4410ccffd8ccfe3664fdb2e20877796d070042030b9cc"} Jun 02 15:25:03.250872 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:03.250835 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm7m9" event={"ID":"659c3a78-ae6d-456e-9e93-1fb8313fe621","Type":"ContainerStarted","Data":"69dd46e830f511a75d0a92946327dcb0f353544d95a364b83d6d324ff82baf28"} Jun 02 15:25:03.251269 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:03.251065 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:25:03.271906 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:03.271815 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qm7m9" podStartSLOduration=66.449454947 podStartE2EDuration="1m9.271801909s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:25:00.194750876 +0000 UTC m=+66.800443552" lastFinishedPulling="2026-06-02 15:25:03.01709784 +0000 UTC m=+69.622790514" observedRunningTime="2026-06-02 15:25:03.27111398 +0000 UTC m=+69.876806686" watchObservedRunningTime="2026-06-02 15:25:03.271801909 +0000 UTC m=+69.877494611" Jun 02 15:25:32.101993 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:32.101950 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:25:32.102440 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:32.102122 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:25:32.102440 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:32.102201 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls podName:adec3c5a-94e4-4775-ba97-1573b0ab830e nodeName:}" failed. No retries permitted until 2026-06-02 15:26:36.10218488 +0000 UTC m=+162.707877552 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls") pod "dns-default-pwpvj" (UID: "adec3c5a-94e4-4775-ba97-1573b0ab830e") : secret "dns-default-metrics-tls" not found Jun 02 15:25:32.202681 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:32.202646 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:25:32.202862 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:32.202815 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:25:32.202930 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:25:32.202913 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert podName:5b201605-4a24-4ba3-9d3d-89b580fd04e0 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:36.202891635 +0000 UTC m=+162.808584313 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert") pod "ingress-canary-tptbf" (UID: "5b201605-4a24-4ba3-9d3d-89b580fd04e0") : secret "canary-serving-cert" not found Jun 02 15:25:34.255516 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:25:34.255481 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qm7m9" Jun 02 15:26:02.500603 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.500550 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-fsqt5"] Jun 02 15:26:02.502373 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.502358 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.506701 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.506677 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 15:26:02.507667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.507650 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.508086 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.508068 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.508477 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.508341 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fqlrs\"" Jun 02 15:26:02.508707 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.508690 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 15:26:02.520401 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.520383 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 15:26:02.544241 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.544221 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-fsqt5"] Jun 02 15:26:02.581686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.581653 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-56xdk"] Jun 02 15:26:02.584186 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.584170 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78dff7b668-4shrx"] Jun 02 15:26:02.584337 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.584320 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.588550 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.588527 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.592260 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.592238 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 15:26:02.592602 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.592582 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6hhnb\"" Jun 02 15:26:02.593002 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.592605 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 15:26:02.593120 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.592679 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 15:26:02.594051 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.594032 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.594287 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.594267 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kbhxp\"" Jun 02 15:26:02.600954 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.600934 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 15:26:02.601048 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.600992 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 15:26:02.601114 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.601076 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.603091 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.603074 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv"] Jun 02 15:26:02.604936 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.604916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09660787-6b25-4901-929c-d7ba2324779c-config\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.604988 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.604939 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" Jun 02 15:26:02.605143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.605121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6mvv\" (UniqueName: \"kubernetes.io/projected/09660787-6b25-4901-929c-d7ba2324779c-kube-api-access-j6mvv\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.605240 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.605161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09660787-6b25-4901-929c-d7ba2324779c-trusted-ca\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.605240 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.605231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09660787-6b25-4901-929c-d7ba2324779c-serving-cert\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.611587 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.611556 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.611675 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.611632 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.612272 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.612252 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-56xdk"] Jun 02 15:26:02.612555 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.612539 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cbrqw\"" Jun 02 15:26:02.613086 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.613071 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 15:26:02.613690 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.613669 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 15:26:02.618182 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.618163 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78dff7b668-4shrx"] Jun 02 15:26:02.622453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.622417 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv"] Jun 02 15:26:02.705959 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.705925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thcg5\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-kube-api-access-thcg5\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.705981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfdac31-e35f-456d-bb99-ac110f9d57dc-serving-cert\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.705998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-trusted-ca\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-bound-sa-token\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-certificates\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh69t\" (UniqueName: \"kubernetes.io/projected/9afcac4b-c2a7-4817-a53b-5f932c8c821f-kube-api-access-kh69t\") pod \"volume-data-source-validator-7598fd5bd-2d4pv\" (UID: \"9afcac4b-c2a7-4817-a53b-5f932c8c821f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706077 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09660787-6b25-4901-929c-d7ba2324779c-serving-cert\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.706130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aec0986f-11f2-4310-bdaf-3101385d4d2b-ca-trust-extracted\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p44gb\" (UniqueName: \"kubernetes.io/projected/9bfdac31-e35f-456d-bb99-ac110f9d57dc-kube-api-access-p44gb\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706185 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09660787-6b25-4901-929c-d7ba2324779c-config\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bfdac31-e35f-456d-bb99-ac110f9d57dc-tmp\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfdac31-e35f-456d-bb99-ac110f9d57dc-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9bfdac31-e35f-456d-bb99-ac110f9d57dc-snapshots\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-installation-pull-secrets\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-image-registry-private-configuration\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706371 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6mvv\" (UniqueName: \"kubernetes.io/projected/09660787-6b25-4901-929c-d7ba2324779c-kube-api-access-j6mvv\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706405 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09660787-6b25-4901-929c-d7ba2324779c-trusted-ca\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.706434 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.706428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfdac31-e35f-456d-bb99-ac110f9d57dc-service-ca-bundle\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.707023 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.707001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09660787-6b25-4901-929c-d7ba2324779c-trusted-ca\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.707023 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.707001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09660787-6b25-4901-929c-d7ba2324779c-config\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.708638 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.708616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09660787-6b25-4901-929c-d7ba2324779c-serving-cert\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.728199 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.728175 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6mvv\" (UniqueName: \"kubernetes.io/projected/09660787-6b25-4901-929c-d7ba2324779c-kube-api-access-j6mvv\") pod \"console-operator-86d7c6cc77-fsqt5\" (UID: \"09660787-6b25-4901-929c-d7ba2324779c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.736652 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.736631 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp"] Jun 02 15:26:02.738432 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.738419 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:02.744331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.744278 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.744708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.744685 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l794z\"" Jun 02 15:26:02.744815 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.744772 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 15:26:02.744937 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.744811 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.760151 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.760096 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp"] Jun 02 15:26:02.807655 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807627 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bfdac31-e35f-456d-bb99-ac110f9d57dc-tmp\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.807764 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807664 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfdac31-e35f-456d-bb99-ac110f9d57dc-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.807764 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807692 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9bfdac31-e35f-456d-bb99-ac110f9d57dc-snapshots\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.807764 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807709 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-installation-pull-secrets\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.807764 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807736 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-image-registry-private-configuration\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807775 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807807 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfdac31-e35f-456d-bb99-ac110f9d57dc-service-ca-bundle\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807835 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thcg5\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-kube-api-access-thcg5\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807922 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfdac31-e35f-456d-bb99-ac110f9d57dc-serving-cert\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:02.807932 2579 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:02.807945 2579 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78dff7b668-4shrx: secret "image-registry-tls" not found Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807948 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-trusted-ca\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.807973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.807973 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-bound-sa-token\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:02.808006 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls podName:aec0986f-11f2-4310-bdaf-3101385d4d2b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:03.307985598 +0000 UTC m=+129.913678289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls") pod "image-registry-78dff7b668-4shrx" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b") : secret "image-registry-tls" not found Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808025 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-certificates\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808057 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh69t\" (UniqueName: \"kubernetes.io/projected/9afcac4b-c2a7-4817-a53b-5f932c8c821f-kube-api-access-kh69t\") pod \"volume-data-source-validator-7598fd5bd-2d4pv\" (UID: \"9afcac4b-c2a7-4817-a53b-5f932c8c821f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808085 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aec0986f-11f2-4310-bdaf-3101385d4d2b-ca-trust-extracted\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvd4h\" (UniqueName: \"kubernetes.io/projected/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-kube-api-access-fvd4h\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808144 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p44gb\" (UniqueName: \"kubernetes.io/projected/9bfdac31-e35f-456d-bb99-ac110f9d57dc-kube-api-access-p44gb\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bfdac31-e35f-456d-bb99-ac110f9d57dc-tmp\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.808366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808339 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9bfdac31-e35f-456d-bb99-ac110f9d57dc-snapshots\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.808938 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aec0986f-11f2-4310-bdaf-3101385d4d2b-ca-trust-extracted\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.808938 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.808726 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfdac31-e35f-456d-bb99-ac110f9d57dc-service-ca-bundle\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.809123 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.809098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-certificates\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.809392 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.809373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bfdac31-e35f-456d-bb99-ac110f9d57dc-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.809392 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.809382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-trusted-ca\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.810549 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.810529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-installation-pull-secrets\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.810549 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.810540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-image-registry-private-configuration\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.810692 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.810677 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:02.810729 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.810692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfdac31-e35f-456d-bb99-ac110f9d57dc-serving-cert\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.819164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.819134 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-bound-sa-token\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.819265 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.819250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p44gb\" (UniqueName: \"kubernetes.io/projected/9bfdac31-e35f-456d-bb99-ac110f9d57dc-kube-api-access-p44gb\") pod \"insights-operator-788bf58df5-56xdk\" (UID: \"9bfdac31-e35f-456d-bb99-ac110f9d57dc\") " pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.819374 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.819342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh69t\" (UniqueName: \"kubernetes.io/projected/9afcac4b-c2a7-4817-a53b-5f932c8c821f-kube-api-access-kh69t\") pod \"volume-data-source-validator-7598fd5bd-2d4pv\" (UID: \"9afcac4b-c2a7-4817-a53b-5f932c8c821f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" Jun 02 15:26:02.819631 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.819610 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thcg5\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-kube-api-access-thcg5\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:02.895884 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.895855 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-56xdk" Jun 02 15:26:02.909075 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.909046 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvd4h\" (UniqueName: \"kubernetes.io/projected/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-kube-api-access-fvd4h\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:02.909182 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.909170 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:02.909321 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:02.909302 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:26:02.909386 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:02.909363 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls podName:e0e38ade-6063-43a8-9ef0-0dbee14ab76b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:03.409349135 +0000 UTC m=+130.015041807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cd7dp" (UID: "e0e38ade-6063-43a8-9ef0-0dbee14ab76b") : secret "samples-operator-tls" not found Jun 02 15:26:02.913939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.913918 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" Jun 02 15:26:02.918867 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.918845 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvd4h\" (UniqueName: \"kubernetes.io/projected/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-kube-api-access-fvd4h\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:02.944733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:02.944016 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-fsqt5"] Jun 02 15:26:02.948646 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:02.948591 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09660787_6b25_4901_929c_d7ba2324779c.slice/crio-f030b942e5a164c97cb3c216612d3e26a64fe900d36b5b0eb636f8b30793d5fb WatchSource:0}: Error finding container f030b942e5a164c97cb3c216612d3e26a64fe900d36b5b0eb636f8b30793d5fb: Status 404 returned error can't find the container with id f030b942e5a164c97cb3c216612d3e26a64fe900d36b5b0eb636f8b30793d5fb Jun 02 15:26:03.028490 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.028407 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-56xdk"] Jun 02 15:26:03.031718 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:03.031692 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfdac31_e35f_456d_bb99_ac110f9d57dc.slice/crio-a0daf6005965d357316c0372e7b960320bea6c7c095098747f468ac612434177 WatchSource:0}: Error finding container a0daf6005965d357316c0372e7b960320bea6c7c095098747f468ac612434177: Status 404 returned error can't find the container with id a0daf6005965d357316c0372e7b960320bea6c7c095098747f468ac612434177 Jun 02 15:26:03.041875 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.041847 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv"] Jun 02 15:26:03.047585 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:03.047545 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afcac4b_c2a7_4817_a53b_5f932c8c821f.slice/crio-786fd035a40797cef782b2efa374da68a83b6d08cfbbb763645a0d3e93a38537 WatchSource:0}: Error finding container 786fd035a40797cef782b2efa374da68a83b6d08cfbbb763645a0d3e93a38537: Status 404 returned error can't find the container with id 786fd035a40797cef782b2efa374da68a83b6d08cfbbb763645a0d3e93a38537 Jun 02 15:26:03.312426 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.312342 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:03.312558 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.312488 2579 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:26:03.312558 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.312507 2579 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78dff7b668-4shrx: secret "image-registry-tls" not found Jun 02 15:26:03.312647 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.312563 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls podName:aec0986f-11f2-4310-bdaf-3101385d4d2b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:04.312546743 +0000 UTC m=+130.918239419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls") pod "image-registry-78dff7b668-4shrx" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b") : secret "image-registry-tls" not found Jun 02 15:26:03.363681 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.363647 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" event={"ID":"9afcac4b-c2a7-4817-a53b-5f932c8c821f","Type":"ContainerStarted","Data":"786fd035a40797cef782b2efa374da68a83b6d08cfbbb763645a0d3e93a38537"} Jun 02 15:26:03.364620 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.364592 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" event={"ID":"09660787-6b25-4901-929c-d7ba2324779c","Type":"ContainerStarted","Data":"f030b942e5a164c97cb3c216612d3e26a64fe900d36b5b0eb636f8b30793d5fb"} Jun 02 15:26:03.365461 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.365441 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-56xdk" event={"ID":"9bfdac31-e35f-456d-bb99-ac110f9d57dc","Type":"ContainerStarted","Data":"a0daf6005965d357316c0372e7b960320bea6c7c095098747f468ac612434177"} Jun 02 15:26:03.413129 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.413097 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:03.413256 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.413239 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:26:03.413323 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.413313 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls podName:e0e38ade-6063-43a8-9ef0-0dbee14ab76b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:04.413298361 +0000 UTC m=+131.018991034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cd7dp" (UID: "e0e38ade-6063-43a8-9ef0-0dbee14ab76b") : secret "samples-operator-tls" not found Jun 02 15:26:03.715919 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:03.715874 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:26:03.716322 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.715997 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:26:03.716322 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:03.716073 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs podName:083a58df-dc26-4e68-b6b7-0b823ff0a87f nodeName:}" failed. No retries permitted until 2026-06-02 15:28:05.716050241 +0000 UTC m=+252.321742921 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs") pod "network-metrics-daemon-45929" (UID: "083a58df-dc26-4e68-b6b7-0b823ff0a87f") : secret "metrics-daemon-secret" not found Jun 02 15:26:04.320936 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:04.320899 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:04.321212 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:04.321125 2579 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:26:04.321212 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:04.321142 2579 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78dff7b668-4shrx: secret "image-registry-tls" not found Jun 02 15:26:04.321212 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:04.321199 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls podName:aec0986f-11f2-4310-bdaf-3101385d4d2b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:06.321180938 +0000 UTC m=+132.926873624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls") pod "image-registry-78dff7b668-4shrx" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b") : secret "image-registry-tls" not found Jun 02 15:26:04.421683 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:04.421645 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:04.421881 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:04.421815 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:26:04.421944 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:04.421893 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls podName:e0e38ade-6063-43a8-9ef0-0dbee14ab76b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:06.42187231 +0000 UTC m=+133.027564985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cd7dp" (UID: "e0e38ade-6063-43a8-9ef0-0dbee14ab76b") : secret "samples-operator-tls" not found Jun 02 15:26:05.371353 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.371315 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" event={"ID":"09660787-6b25-4901-929c-d7ba2324779c","Type":"ContainerStarted","Data":"4406f09f7c3baf16af133e6ccea636ad191bea47962885412ac15f305736b47e"} Jun 02 15:26:05.371834 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.371749 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:05.372981 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.372945 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" event={"ID":"9afcac4b-c2a7-4817-a53b-5f932c8c821f","Type":"ContainerStarted","Data":"5d976d2055a634f49413eaafddb54ba25a00720ee717a2447d49aa2418042b82"} Jun 02 15:26:05.373360 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.373336 2579 patch_prober.go:28] interesting pod/console-operator-86d7c6cc77-fsqt5 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.7:8443/readyz\": dial tcp 10.134.0.7:8443: connect: connection refused" start-of-body= Jun 02 15:26:05.373473 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.373381 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" podUID="09660787-6b25-4901-929c-d7ba2324779c" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.7:8443/readyz\": dial tcp 10.134.0.7:8443: connect: connection refused" Jun 02 15:26:05.389975 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.389884 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" podStartSLOduration=1.213331111 podStartE2EDuration="3.389869452s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:02.951066665 +0000 UTC m=+129.556759350" lastFinishedPulling="2026-06-02 15:26:05.127605018 +0000 UTC m=+131.733297691" observedRunningTime="2026-06-02 15:26:05.388399765 +0000 UTC m=+131.994092461" watchObservedRunningTime="2026-06-02 15:26:05.389869452 +0000 UTC m=+131.995562146" Jun 02 15:26:05.405164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:05.405117 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2d4pv" podStartSLOduration=1.9207507769999999 podStartE2EDuration="3.405103549s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:03.049324099 +0000 UTC m=+129.655016771" lastFinishedPulling="2026-06-02 15:26:04.533676867 +0000 UTC m=+131.139369543" observedRunningTime="2026-06-02 15:26:05.404040522 +0000 UTC m=+132.009733215" watchObservedRunningTime="2026-06-02 15:26:05.405103549 +0000 UTC m=+132.010796243" Jun 02 15:26:06.336181 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.336137 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:06.336376 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:06.336289 2579 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:26:06.336376 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:06.336310 2579 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78dff7b668-4shrx: secret "image-registry-tls" not found Jun 02 15:26:06.336376 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:06.336363 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls podName:aec0986f-11f2-4310-bdaf-3101385d4d2b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:10.336348098 +0000 UTC m=+136.942040770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls") pod "image-registry-78dff7b668-4shrx" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b") : secret "image-registry-tls" not found Jun 02 15:26:06.375895 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.375872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/0.log" Jun 02 15:26:06.376320 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.375910 2579 generic.go:358] "Generic (PLEG): container finished" podID="09660787-6b25-4901-929c-d7ba2324779c" containerID="4406f09f7c3baf16af133e6ccea636ad191bea47962885412ac15f305736b47e" exitCode=255 Jun 02 15:26:06.376320 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.375965 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" event={"ID":"09660787-6b25-4901-929c-d7ba2324779c","Type":"ContainerDied","Data":"4406f09f7c3baf16af133e6ccea636ad191bea47962885412ac15f305736b47e"} Jun 02 15:26:06.376320 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.376265 2579 scope.go:117] "RemoveContainer" containerID="4406f09f7c3baf16af133e6ccea636ad191bea47962885412ac15f305736b47e" Jun 02 15:26:06.377326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.377301 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-56xdk" event={"ID":"9bfdac31-e35f-456d-bb99-ac110f9d57dc","Type":"ContainerStarted","Data":"554b32a76de661fc3b34fc8d4bdc2cca7568ce07f4698a5da0d0a0412f593c3d"} Jun 02 15:26:06.414927 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.414860 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-56xdk" podStartSLOduration=1.68938147 podStartE2EDuration="4.414841474s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:03.033474221 +0000 UTC m=+129.639166894" lastFinishedPulling="2026-06-02 15:26:05.758934224 +0000 UTC m=+132.364626898" observedRunningTime="2026-06-02 15:26:06.414311073 +0000 UTC m=+133.020003767" watchObservedRunningTime="2026-06-02 15:26:06.414841474 +0000 UTC m=+133.020534170" Jun 02 15:26:06.437234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:06.437088 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:06.437380 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:06.437208 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:26:06.437756 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:06.437742 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls podName:e0e38ade-6063-43a8-9ef0-0dbee14ab76b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:10.437344552 +0000 UTC m=+137.043037231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cd7dp" (UID: "e0e38ade-6063-43a8-9ef0-0dbee14ab76b") : secret "samples-operator-tls" not found Jun 02 15:26:07.232081 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.232042 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n"] Jun 02 15:26:07.234063 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.234047 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" Jun 02 15:26:07.236829 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.236806 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 15:26:07.237893 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.237875 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wp9mj\"" Jun 02 15:26:07.237989 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.237893 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 15:26:07.246867 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.246844 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n"] Jun 02 15:26:07.343855 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.343815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxd5s\" (UniqueName: \"kubernetes.io/projected/c9b08412-e8e3-4364-b733-2a041c6192a9-kube-api-access-qxd5s\") pod \"migrator-96c6f749-xnn7n\" (UID: \"c9b08412-e8e3-4364-b733-2a041c6192a9\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" Jun 02 15:26:07.380705 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.380679 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:26:07.381069 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.381044 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/0.log" Jun 02 15:26:07.381111 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.381076 2579 generic.go:358] "Generic (PLEG): container finished" podID="09660787-6b25-4901-929c-d7ba2324779c" containerID="265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa" exitCode=255 Jun 02 15:26:07.381176 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.381159 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" event={"ID":"09660787-6b25-4901-929c-d7ba2324779c","Type":"ContainerDied","Data":"265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa"} Jun 02 15:26:07.381210 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.381198 2579 scope.go:117] "RemoveContainer" containerID="4406f09f7c3baf16af133e6ccea636ad191bea47962885412ac15f305736b47e" Jun 02 15:26:07.381399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.381380 2579 scope.go:117] "RemoveContainer" containerID="265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa" Jun 02 15:26:07.381645 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:07.381623 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fsqt5_openshift-console-operator(09660787-6b25-4901-929c-d7ba2324779c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" podUID="09660787-6b25-4901-929c-d7ba2324779c" Jun 02 15:26:07.444706 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.444680 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxd5s\" (UniqueName: \"kubernetes.io/projected/c9b08412-e8e3-4364-b733-2a041c6192a9-kube-api-access-qxd5s\") pod \"migrator-96c6f749-xnn7n\" (UID: \"c9b08412-e8e3-4364-b733-2a041c6192a9\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" Jun 02 15:26:07.453444 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.453423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxd5s\" (UniqueName: \"kubernetes.io/projected/c9b08412-e8e3-4364-b733-2a041c6192a9-kube-api-access-qxd5s\") pod \"migrator-96c6f749-xnn7n\" (UID: \"c9b08412-e8e3-4364-b733-2a041c6192a9\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" Jun 02 15:26:07.542701 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.542627 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" Jun 02 15:26:07.669857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:07.669692 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n"] Jun 02 15:26:07.672186 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:07.672155 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b08412_e8e3_4364_b733_2a041c6192a9.slice/crio-c3c5186a54feca59e656f661e9640450dbe72660013efaf8fd57ed851d256b34 WatchSource:0}: Error finding container c3c5186a54feca59e656f661e9640450dbe72660013efaf8fd57ed851d256b34: Status 404 returned error can't find the container with id c3c5186a54feca59e656f661e9640450dbe72660013efaf8fd57ed851d256b34 Jun 02 15:26:08.384945 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:08.384906 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" event={"ID":"c9b08412-e8e3-4364-b733-2a041c6192a9","Type":"ContainerStarted","Data":"c3c5186a54feca59e656f661e9640450dbe72660013efaf8fd57ed851d256b34"} Jun 02 15:26:08.386279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:08.386259 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:26:08.386700 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:08.386678 2579 scope.go:117] "RemoveContainer" containerID="265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa" Jun 02 15:26:08.386923 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:08.386899 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fsqt5_openshift-console-operator(09660787-6b25-4901-929c-d7ba2324779c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" podUID="09660787-6b25-4901-929c-d7ba2324779c" Jun 02 15:26:08.758514 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:08.758427 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pdsnj_03565e0a-bb85-459f-8a11-65d33ab6d886/dns-node-resolver/0.log" Jun 02 15:26:09.358417 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:09.358392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2n8tv_d600b7e7-6b95-4a6f-b662-c9f0f117119c/node-ca/0.log" Jun 02 15:26:09.390557 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:09.390522 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" event={"ID":"c9b08412-e8e3-4364-b733-2a041c6192a9","Type":"ContainerStarted","Data":"4598f4b611213675d849d14129f1a6e4e1d16b2d41380f661edf5eb744c0521f"} Jun 02 15:26:09.390557 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:09.390561 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" event={"ID":"c9b08412-e8e3-4364-b733-2a041c6192a9","Type":"ContainerStarted","Data":"56ff0c04eee4e7831f9c87a4ab8dfb55579145e7743bd4bd73fadb36a38d0e9a"} Jun 02 15:26:09.407747 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:09.407663 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xnn7n" podStartSLOduration=0.935964983 podStartE2EDuration="2.407650041s" podCreationTimestamp="2026-06-02 15:26:07 +0000 UTC" firstStartedPulling="2026-06-02 15:26:07.673987096 +0000 UTC m=+134.279679774" lastFinishedPulling="2026-06-02 15:26:09.14567216 +0000 UTC m=+135.751364832" observedRunningTime="2026-06-02 15:26:09.406727201 +0000 UTC m=+136.012419889" watchObservedRunningTime="2026-06-02 15:26:09.407650041 +0000 UTC m=+136.013342737" Jun 02 15:26:10.367297 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:10.367256 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:10.367479 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:10.367414 2579 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:26:10.367479 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:10.367430 2579 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78dff7b668-4shrx: secret "image-registry-tls" not found Jun 02 15:26:10.367549 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:10.367486 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls podName:aec0986f-11f2-4310-bdaf-3101385d4d2b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:18.367470025 +0000 UTC m=+144.973162699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls") pod "image-registry-78dff7b668-4shrx" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b") : secret "image-registry-tls" not found Jun 02 15:26:10.468196 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:10.468154 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:10.468558 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:10.468284 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:26:10.468558 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:10.468365 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls podName:e0e38ade-6063-43a8-9ef0-0dbee14ab76b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:18.468349648 +0000 UTC m=+145.074042334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cd7dp" (UID: "e0e38ade-6063-43a8-9ef0-0dbee14ab76b") : secret "samples-operator-tls" not found Jun 02 15:26:12.811786 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:12.811742 2579 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:12.812232 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:12.812215 2579 scope.go:117] "RemoveContainer" containerID="265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa" Jun 02 15:26:12.812438 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:12.812414 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fsqt5_openshift-console-operator(09660787-6b25-4901-929c-d7ba2324779c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" podUID="09660787-6b25-4901-929c-d7ba2324779c" Jun 02 15:26:15.372102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:15.372055 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:15.372634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:15.372548 2579 scope.go:117] "RemoveContainer" containerID="265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa" Jun 02 15:26:15.372814 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:15.372792 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fsqt5_openshift-console-operator(09660787-6b25-4901-929c-d7ba2324779c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" podUID="09660787-6b25-4901-929c-d7ba2324779c" Jun 02 15:26:18.430388 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.430353 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:18.432824 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.432803 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"image-registry-78dff7b668-4shrx\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:18.500497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.500466 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:18.530976 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.530946 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:18.533469 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.533446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0e38ade-6063-43a8-9ef0-0dbee14ab76b-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cd7dp\" (UID: \"e0e38ade-6063-43a8-9ef0-0dbee14ab76b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:18.634741 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.634707 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78dff7b668-4shrx"] Jun 02 15:26:18.637437 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:18.637408 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec0986f_11f2_4310_bdaf_3101385d4d2b.slice/crio-4918b3841c57e1d3fd8aacefbdecaad54383fa96e092de246233340133926b3e WatchSource:0}: Error finding container 4918b3841c57e1d3fd8aacefbdecaad54383fa96e092de246233340133926b3e: Status 404 returned error can't find the container with id 4918b3841c57e1d3fd8aacefbdecaad54383fa96e092de246233340133926b3e Jun 02 15:26:18.646680 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.646661 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" Jun 02 15:26:18.775188 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:18.775145 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp"] Jun 02 15:26:19.418582 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:19.418541 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" event={"ID":"e0e38ade-6063-43a8-9ef0-0dbee14ab76b","Type":"ContainerStarted","Data":"d1bda2dc3fb6cd49365bbc28d6a9887dd122808d09df3e62587c3e0fdbce785b"} Jun 02 15:26:19.419816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:19.419785 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" event={"ID":"aec0986f-11f2-4310-bdaf-3101385d4d2b","Type":"ContainerStarted","Data":"33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6"} Jun 02 15:26:19.419816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:19.419819 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" event={"ID":"aec0986f-11f2-4310-bdaf-3101385d4d2b","Type":"ContainerStarted","Data":"4918b3841c57e1d3fd8aacefbdecaad54383fa96e092de246233340133926b3e"} Jun 02 15:26:19.420007 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:19.419913 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:19.443457 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:19.443415 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" podStartSLOduration=17.443403827 podStartE2EDuration="17.443403827s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:19.443257215 +0000 UTC m=+146.048949923" watchObservedRunningTime="2026-06-02 15:26:19.443403827 +0000 UTC m=+146.049096521" Jun 02 15:26:21.425646 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:21.425609 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" event={"ID":"e0e38ade-6063-43a8-9ef0-0dbee14ab76b","Type":"ContainerStarted","Data":"93b5cadaa33ffcc5a11944566951c18d7d622ef850ff91e2d912951680c95d3d"} Jun 02 15:26:21.425646 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:21.425650 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" event={"ID":"e0e38ade-6063-43a8-9ef0-0dbee14ab76b","Type":"ContainerStarted","Data":"78f04c1a4cbef2b497c678e2555a01e2d231de544681066824637dc41436113f"} Jun 02 15:26:21.443664 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:21.443618 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cd7dp" podStartSLOduration=17.434281351 podStartE2EDuration="19.443603651s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:18.82020479 +0000 UTC m=+145.425897461" lastFinishedPulling="2026-06-02 15:26:20.829527086 +0000 UTC m=+147.435219761" observedRunningTime="2026-06-02 15:26:21.443114925 +0000 UTC m=+148.048807618" watchObservedRunningTime="2026-06-02 15:26:21.443603651 +0000 UTC m=+148.049296343" Jun 02 15:26:26.029932 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:26.029895 2579 scope.go:117] "RemoveContainer" containerID="265098a3bee4a74f065da4659bda4cdc3f51f57ed436b48ce7512336972528aa" Jun 02 15:26:26.438875 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:26.438847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:26:26.439039 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:26.438916 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" event={"ID":"09660787-6b25-4901-929c-d7ba2324779c","Type":"ContainerStarted","Data":"1cf8aec3beca05cd1a44c69c4dad0273b2c53edbf385e6352fe76c7e7b1392b5"} Jun 02 15:26:26.439178 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:26.439159 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:27.220435 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:27.220406 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fsqt5" Jun 02 15:26:31.292319 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:31.292254 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pwpvj" podUID="adec3c5a-94e4-4775-ba97-1573b0ab830e" Jun 02 15:26:31.311587 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:31.311536 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-tptbf" podUID="5b201605-4a24-4ba3-9d3d-89b580fd04e0" Jun 02 15:26:31.451014 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:31.450983 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwpvj" Jun 02 15:26:33.038637 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:33.038594 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-45929" podUID="083a58df-dc26-4e68-b6b7-0b823ff0a87f" Jun 02 15:26:36.167198 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.167147 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:26:36.169642 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.169619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adec3c5a-94e4-4775-ba97-1573b0ab830e-metrics-tls\") pod \"dns-default-pwpvj\" (UID: \"adec3c5a-94e4-4775-ba97-1573b0ab830e\") " pod="openshift-dns/dns-default-pwpvj" Jun 02 15:26:36.254815 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.254785 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqlt7\"" Jun 02 15:26:36.262299 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.262279 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwpvj" Jun 02 15:26:36.268129 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.268110 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:26:36.270510 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.270490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b201605-4a24-4ba3-9d3d-89b580fd04e0-cert\") pod \"ingress-canary-tptbf\" (UID: \"5b201605-4a24-4ba3-9d3d-89b580fd04e0\") " pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:26:36.397122 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.397097 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwpvj"] Jun 02 15:26:36.399510 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:36.399478 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadec3c5a_94e4_4775_ba97_1573b0ab830e.slice/crio-1408638bdefa56b99552f643e29f9752cb243c1b1e7534400a0001d65c7aec4d WatchSource:0}: Error finding container 1408638bdefa56b99552f643e29f9752cb243c1b1e7534400a0001d65c7aec4d: Status 404 returned error can't find the container with id 1408638bdefa56b99552f643e29f9752cb243c1b1e7534400a0001d65c7aec4d Jun 02 15:26:36.464795 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:36.464709 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwpvj" event={"ID":"adec3c5a-94e4-4775-ba97-1573b0ab830e","Type":"ContainerStarted","Data":"1408638bdefa56b99552f643e29f9752cb243c1b1e7534400a0001d65c7aec4d"} Jun 02 15:26:37.589345 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.589310 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z"] Jun 02 15:26:37.592039 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.592009 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.596043 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.596017 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x8nlj\"" Jun 02 15:26:37.596147 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.596021 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 15:26:37.596147 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.596021 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 15:26:37.600773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.600409 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78dff7b668-4shrx"] Jun 02 15:26:37.605221 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.605196 2579 patch_prober.go:28] interesting pod/image-registry-78dff7b668-4shrx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 15:26:37.605334 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.605254 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" podUID="aec0986f-11f2-4310-bdaf-3101385d4d2b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:26:37.611590 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.611552 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z"] Jun 02 15:26:37.675630 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.675600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/252ea2b0-bc1c-4262-85b3-a81a958e4c42-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-pmb4z\" (UID: \"252ea2b0-bc1c-4262-85b3-a81a958e4c42\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.675773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.675659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/252ea2b0-bc1c-4262-85b3-a81a958e4c42-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-pmb4z\" (UID: \"252ea2b0-bc1c-4262-85b3-a81a958e4c42\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.715694 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.715663 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86cd695c95-zqj5h"] Jun 02 15:26:37.719888 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.719863 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4"] Jun 02 15:26:37.720204 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.720178 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.722946 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.722923 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-b77m2"] Jun 02 15:26:37.723081 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.723064 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:37.725860 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.725842 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:37.776946 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.776916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-serving-cert\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.777067 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.776956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckr5\" (UniqueName: \"kubernetes.io/projected/7ea14e64-23d4-491b-abbd-12b111d8d1f9-kube-api-access-bckr5\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.777067 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.776975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-oauth-serving-cert\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.777067 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-kbcj4\" (UID: \"2d02ad11-6669-4bc2-990d-13cd6628e37f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:37.777172 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777068 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/252ea2b0-bc1c-4262-85b3-a81a958e4c42-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-pmb4z\" (UID: \"252ea2b0-bc1c-4262-85b3-a81a958e4c42\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.777172 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhw5q\" (UniqueName: \"kubernetes.io/projected/b89cb5b3-671a-4887-9c8b-fa5a229766d9-kube-api-access-jhw5q\") pod \"downloads-c65b8dc4b-b77m2\" (UID: \"b89cb5b3-671a-4887-9c8b-fa5a229766d9\") " pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:37.777172 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777131 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/252ea2b0-bc1c-4262-85b3-a81a958e4c42-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-pmb4z\" (UID: \"252ea2b0-bc1c-4262-85b3-a81a958e4c42\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.777172 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-service-ca\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.777306 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-oauth-config\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.777306 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.777205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-config\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.778399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.778379 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/252ea2b0-bc1c-4262-85b3-a81a958e4c42-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-pmb4z\" (UID: \"252ea2b0-bc1c-4262-85b3-a81a958e4c42\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.780145 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.780129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/252ea2b0-bc1c-4262-85b3-a81a958e4c42-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-pmb4z\" (UID: \"252ea2b0-bc1c-4262-85b3-a81a958e4c42\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.794634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.794615 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 15:26:37.794634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.794626 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 15:26:37.794788 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.794634 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 15:26:37.794788 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.794666 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 15:26:37.817634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.817609 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 15:26:37.819398 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.819381 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 15:26:37.819491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.819387 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g87xd\"" Jun 02 15:26:37.820498 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.820480 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 15:26:37.820605 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.820546 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cd695c95-zqj5h"] Jun 02 15:26:37.821315 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.821296 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-b77m2"] Jun 02 15:26:37.821519 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.821503 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9djld\"" Jun 02 15:26:37.821989 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.821973 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fq9wv"] Jun 02 15:26:37.822167 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.822148 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5zjbk\"" Jun 02 15:26:37.825067 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.825052 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.830105 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.830045 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 15:26:37.833230 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:37.833207 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-141-151.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-151.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 02 15:26:37.833685 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:37.833661 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-nv42j\" is forbidden: User \"system:node:ip-10-0-141-151.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-151.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nv42j\"" type="*v1.Secret" Jun 02 15:26:37.833785 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:37.833714 2579 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-141-151.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-151.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 02 15:26:37.848188 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.847198 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4"] Jun 02 15:26:37.877651 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877524 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-service-ca\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.877651 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6x4q\" (UniqueName: \"kubernetes.io/projected/9407601b-f09f-4c04-bfb5-5986da15eabc-kube-api-access-p6x4q\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.877651 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877644 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-oauth-config\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.877947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877669 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-config\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.877947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877733 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-serving-cert\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.877947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9407601b-f09f-4c04-bfb5-5986da15eabc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.877947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877818 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bckr5\" (UniqueName: \"kubernetes.io/projected/7ea14e64-23d4-491b-abbd-12b111d8d1f9-kube-api-access-bckr5\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.877947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877848 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-oauth-serving-cert\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.877947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.877881 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-kbcj4\" (UID: \"2d02ad11-6669-4bc2-990d-13cd6628e37f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:37.878244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.878040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9407601b-f09f-4c04-bfb5-5986da15eabc-crio-socket\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.878244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.878068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9407601b-f09f-4c04-bfb5-5986da15eabc-data-volume\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.878244 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:37.878080 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 15:26:37.878244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.878158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9407601b-f09f-4c04-bfb5-5986da15eabc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.878244 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:37.878193 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates podName:2d02ad11-6669-4bc2-990d-13cd6628e37f nodeName:}" failed. No retries permitted until 2026-06-02 15:26:38.378161524 +0000 UTC m=+164.983854195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-kbcj4" (UID: "2d02ad11-6669-4bc2-990d-13cd6628e37f") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 15:26:37.878485 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.878435 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhw5q\" (UniqueName: \"kubernetes.io/projected/b89cb5b3-671a-4887-9c8b-fa5a229766d9-kube-api-access-jhw5q\") pod \"downloads-c65b8dc4b-b77m2\" (UID: \"b89cb5b3-671a-4887-9c8b-fa5a229766d9\") " pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:37.878739 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.878693 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-config\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.879491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.878838 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-oauth-serving-cert\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.879491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.879228 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-service-ca\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.881667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.881640 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fq9wv"] Jun 02 15:26:37.881813 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.881791 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-serving-cert\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.882674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.882655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-oauth-config\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.903347 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.903320 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" Jun 02 15:26:37.909007 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.908983 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckr5\" (UniqueName: \"kubernetes.io/projected/7ea14e64-23d4-491b-abbd-12b111d8d1f9-kube-api-access-bckr5\") pod \"console-86cd695c95-zqj5h\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:37.909261 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.909225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhw5q\" (UniqueName: \"kubernetes.io/projected/b89cb5b3-671a-4887-9c8b-fa5a229766d9-kube-api-access-jhw5q\") pod \"downloads-c65b8dc4b-b77m2\" (UID: \"b89cb5b3-671a-4887-9c8b-fa5a229766d9\") " pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:37.979660 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979629 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9407601b-f09f-4c04-bfb5-5986da15eabc-crio-socket\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.979801 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979664 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9407601b-f09f-4c04-bfb5-5986da15eabc-data-volume\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.979801 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979761 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9407601b-f09f-4c04-bfb5-5986da15eabc-crio-socket\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.979801 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979771 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9407601b-f09f-4c04-bfb5-5986da15eabc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.979982 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979855 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6x4q\" (UniqueName: \"kubernetes.io/projected/9407601b-f09f-4c04-bfb5-5986da15eabc-kube-api-access-p6x4q\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.979982 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979926 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9407601b-f09f-4c04-bfb5-5986da15eabc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:37.980087 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:37.979996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9407601b-f09f-4c04-bfb5-5986da15eabc-data-volume\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:38.006501 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.006476 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6x4q\" (UniqueName: \"kubernetes.io/projected/9407601b-f09f-4c04-bfb5-5986da15eabc-kube-api-access-p6x4q\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:38.034415 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.034388 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z"] Jun 02 15:26:38.037309 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:38.037281 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252ea2b0_bc1c_4262_85b3_a81a958e4c42.slice/crio-56705850ff9dfc1f0b4568c273ddb256fc1a44ad37a0fcb5658ba6708b1bc51d WatchSource:0}: Error finding container 56705850ff9dfc1f0b4568c273ddb256fc1a44ad37a0fcb5658ba6708b1bc51d: Status 404 returned error can't find the container with id 56705850ff9dfc1f0b4568c273ddb256fc1a44ad37a0fcb5658ba6708b1bc51d Jun 02 15:26:38.096373 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.096296 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:38.119466 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.119435 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:38.275202 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.275172 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cd695c95-zqj5h"] Jun 02 15:26:38.278198 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:38.278161 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea14e64_23d4_491b_abbd_12b111d8d1f9.slice/crio-e24927afed584388e8e1b00d029c385b1fde1dddacc01aa0770c532e5b1a337a WatchSource:0}: Error finding container e24927afed584388e8e1b00d029c385b1fde1dddacc01aa0770c532e5b1a337a: Status 404 returned error can't find the container with id e24927afed584388e8e1b00d029c385b1fde1dddacc01aa0770c532e5b1a337a Jun 02 15:26:38.298442 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:38.298378 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89cb5b3_671a_4887_9c8b_fa5a229766d9.slice/crio-68312b04e98242d198d3b0f3ca2c1d7aabd16cac631d1254d6404fe9f4039e09 WatchSource:0}: Error finding container 68312b04e98242d198d3b0f3ca2c1d7aabd16cac631d1254d6404fe9f4039e09: Status 404 returned error can't find the container with id 68312b04e98242d198d3b0f3ca2c1d7aabd16cac631d1254d6404fe9f4039e09 Jun 02 15:26:38.298533 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.298448 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-b77m2"] Jun 02 15:26:38.382262 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.382184 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-kbcj4\" (UID: \"2d02ad11-6669-4bc2-990d-13cd6628e37f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:38.382416 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:38.382325 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 15:26:38.382416 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:38.382394 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates podName:2d02ad11-6669-4bc2-990d-13cd6628e37f nodeName:}" failed. No retries permitted until 2026-06-02 15:26:39.382373983 +0000 UTC m=+165.988066656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-kbcj4" (UID: "2d02ad11-6669-4bc2-990d-13cd6628e37f") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 15:26:38.470933 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.470887 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-b77m2" event={"ID":"b89cb5b3-671a-4887-9c8b-fa5a229766d9","Type":"ContainerStarted","Data":"68312b04e98242d198d3b0f3ca2c1d7aabd16cac631d1254d6404fe9f4039e09"} Jun 02 15:26:38.472471 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.472444 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwpvj" event={"ID":"adec3c5a-94e4-4775-ba97-1573b0ab830e","Type":"ContainerStarted","Data":"2574323fb0ee26c91e46dc47c6712ba5a4c4ceca5c4a1b16f101d02b216e878d"} Jun 02 15:26:38.472603 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.472475 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwpvj" event={"ID":"adec3c5a-94e4-4775-ba97-1573b0ab830e","Type":"ContainerStarted","Data":"734bb37764dcfef31c2f0de6449bc520ee0c42a09db83e3405e449f1f5757f18"} Jun 02 15:26:38.472652 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.472611 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pwpvj" Jun 02 15:26:38.473524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.473504 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cd695c95-zqj5h" event={"ID":"7ea14e64-23d4-491b-abbd-12b111d8d1f9","Type":"ContainerStarted","Data":"e24927afed584388e8e1b00d029c385b1fde1dddacc01aa0770c532e5b1a337a"} Jun 02 15:26:38.474368 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.474349 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" event={"ID":"252ea2b0-bc1c-4262-85b3-a81a958e4c42","Type":"ContainerStarted","Data":"56705850ff9dfc1f0b4568c273ddb256fc1a44ad37a0fcb5658ba6708b1bc51d"} Jun 02 15:26:38.507545 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.507495 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-pwpvj" podStartSLOduration=129.233552217 podStartE2EDuration="2m10.507481922s" podCreationTimestamp="2026-06-02 15:24:28 +0000 UTC" firstStartedPulling="2026-06-02 15:26:36.401314335 +0000 UTC m=+163.007007010" lastFinishedPulling="2026-06-02 15:26:37.675244032 +0000 UTC m=+164.280936715" observedRunningTime="2026-06-02 15:26:38.50636849 +0000 UTC m=+165.112061183" watchObservedRunningTime="2026-06-02 15:26:38.507481922 +0000 UTC m=+165.113174618" Jun 02 15:26:38.678816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.678734 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 15:26:38.683059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.683039 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9407601b-f09f-4c04-bfb5-5986da15eabc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:38.741101 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.741068 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 15:26:38.751130 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:38.751105 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9407601b-f09f-4c04-bfb5-5986da15eabc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fq9wv\" (UID: \"9407601b-f09f-4c04-bfb5-5986da15eabc\") " pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:39.235501 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.235461 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nv42j\"" Jun 02 15:26:39.244036 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.244002 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fq9wv" Jun 02 15:26:39.389959 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.389927 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-kbcj4\" (UID: \"2d02ad11-6669-4bc2-990d-13cd6628e37f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:39.392726 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.392697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2d02ad11-6669-4bc2-990d-13cd6628e37f-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-kbcj4\" (UID: \"2d02ad11-6669-4bc2-990d-13cd6628e37f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:39.403075 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.403048 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fq9wv"] Jun 02 15:26:39.613632 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.613522 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:39.913767 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:39.913735 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4"] Jun 02 15:26:39.917832 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:39.917807 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d02ad11_6669_4bc2_990d_13cd6628e37f.slice/crio-47555c69ef7afa5b62a807471088ea4ba0e97008d96e36abc4558b0cf836fd77 WatchSource:0}: Error finding container 47555c69ef7afa5b62a807471088ea4ba0e97008d96e36abc4558b0cf836fd77: Status 404 returned error can't find the container with id 47555c69ef7afa5b62a807471088ea4ba0e97008d96e36abc4558b0cf836fd77 Jun 02 15:26:40.487941 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:40.487788 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" event={"ID":"2d02ad11-6669-4bc2-990d-13cd6628e37f","Type":"ContainerStarted","Data":"47555c69ef7afa5b62a807471088ea4ba0e97008d96e36abc4558b0cf836fd77"} Jun 02 15:26:40.489251 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:40.489227 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" event={"ID":"252ea2b0-bc1c-4262-85b3-a81a958e4c42","Type":"ContainerStarted","Data":"73ebab7bc9202a7c0a23254846193c575f96597a8f4f8129ed762f2d851e74d3"} Jun 02 15:26:40.490612 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:40.490587 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fq9wv" event={"ID":"9407601b-f09f-4c04-bfb5-5986da15eabc","Type":"ContainerStarted","Data":"c35e40c3cb8fab62e3be076af6edb27a2a1137867ee6dea2246ca5d931c2a1af"} Jun 02 15:26:40.490708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:40.490619 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fq9wv" event={"ID":"9407601b-f09f-4c04-bfb5-5986da15eabc","Type":"ContainerStarted","Data":"cb4a3877a3327a6e1ff32b30302bf6f2daa029f25d1e689587aadfd54e13fe7c"} Jun 02 15:26:40.490708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:40.490632 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fq9wv" event={"ID":"9407601b-f09f-4c04-bfb5-5986da15eabc","Type":"ContainerStarted","Data":"1cf22dc630887ca2808c674dcd590c89576f78fd8686567160ab144beba589b5"} Jun 02 15:26:40.511904 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:40.511851 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-pmb4z" podStartSLOduration=1.7445900920000001 podStartE2EDuration="3.511835664s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:38.039042021 +0000 UTC m=+164.644734696" lastFinishedPulling="2026-06-02 15:26:39.806287589 +0000 UTC m=+166.411980268" observedRunningTime="2026-06-02 15:26:40.510494651 +0000 UTC m=+167.116187342" watchObservedRunningTime="2026-06-02 15:26:40.511835664 +0000 UTC m=+167.117528359" Jun 02 15:26:42.499060 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:42.498963 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cd695c95-zqj5h" event={"ID":"7ea14e64-23d4-491b-abbd-12b111d8d1f9","Type":"ContainerStarted","Data":"dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93"} Jun 02 15:26:42.500778 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:42.500752 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" event={"ID":"2d02ad11-6669-4bc2-990d-13cd6628e37f","Type":"ContainerStarted","Data":"517748b2f304f62f6e8fa8ba8fef33d6daabcdb0444624668a8e422e5c7fce0f"} Jun 02 15:26:42.501151 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:42.501130 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:42.507241 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:42.507218 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" Jun 02 15:26:42.561136 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:42.561074 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-kbcj4" podStartSLOduration=3.348150934 podStartE2EDuration="5.561059161s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:39.920004354 +0000 UTC m=+166.525697028" lastFinishedPulling="2026-06-02 15:26:42.132912575 +0000 UTC m=+168.738605255" observedRunningTime="2026-06-02 15:26:42.559012642 +0000 UTC m=+169.164705338" watchObservedRunningTime="2026-06-02 15:26:42.561059161 +0000 UTC m=+169.166751854" Jun 02 15:26:42.561560 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:42.561524 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86cd695c95-zqj5h" podStartSLOduration=1.7051172239999999 podStartE2EDuration="5.561516159s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:38.280077995 +0000 UTC m=+164.885770670" lastFinishedPulling="2026-06-02 15:26:42.136476922 +0000 UTC m=+168.742169605" observedRunningTime="2026-06-02 15:26:42.53137913 +0000 UTC m=+169.137071826" watchObservedRunningTime="2026-06-02 15:26:42.561516159 +0000 UTC m=+169.167208850" Jun 02 15:26:43.505586 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:43.505531 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fq9wv" event={"ID":"9407601b-f09f-4c04-bfb5-5986da15eabc","Type":"ContainerStarted","Data":"b327f09237d1a4b6196f20b58adad875ed89b7c453a592bd79b27d81f5b004dc"} Jun 02 15:26:43.532375 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:43.532320 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fq9wv" podStartSLOduration=3.361368381 podStartE2EDuration="6.532304315s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:39.834454456 +0000 UTC m=+166.440147129" lastFinishedPulling="2026-06-02 15:26:43.005390392 +0000 UTC m=+169.611083063" observedRunningTime="2026-06-02 15:26:43.530653377 +0000 UTC m=+170.136346072" watchObservedRunningTime="2026-06-02 15:26:43.532304315 +0000 UTC m=+170.137996990" Jun 02 15:26:44.029797 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:44.029767 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:26:45.026562 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:45.026524 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:26:45.029780 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:45.029759 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb47d\"" Jun 02 15:26:45.037414 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:45.037393 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tptbf" Jun 02 15:26:45.167679 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:45.167633 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tptbf"] Jun 02 15:26:45.173216 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:45.173184 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b201605_4a24_4ba3_9d3d_89b580fd04e0.slice/crio-d331f3b54a5e1c24fa6436fe1b0ad9ec4aa55e9cf6e334435ab140d89415ce7c WatchSource:0}: Error finding container d331f3b54a5e1c24fa6436fe1b0ad9ec4aa55e9cf6e334435ab140d89415ce7c: Status 404 returned error can't find the container with id d331f3b54a5e1c24fa6436fe1b0ad9ec4aa55e9cf6e334435ab140d89415ce7c Jun 02 15:26:45.513452 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:45.513412 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tptbf" event={"ID":"5b201605-4a24-4ba3-9d3d-89b580fd04e0","Type":"ContainerStarted","Data":"d331f3b54a5e1c24fa6436fe1b0ad9ec4aa55e9cf6e334435ab140d89415ce7c"} Jun 02 15:26:47.521965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:47.521924 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tptbf" event={"ID":"5b201605-4a24-4ba3-9d3d-89b580fd04e0","Type":"ContainerStarted","Data":"400b3a7ce4390b91d1b907afa728bc1653ba61d0ae4ca06b369ab426be3868d4"} Jun 02 15:26:47.604706 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:47.604677 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:26:47.626501 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:47.626450 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tptbf" podStartSLOduration=138.052263816 podStartE2EDuration="2m19.626435758s" podCreationTimestamp="2026-06-02 15:24:28 +0000 UTC" firstStartedPulling="2026-06-02 15:26:45.176003407 +0000 UTC m=+171.781696104" lastFinishedPulling="2026-06-02 15:26:46.750175374 +0000 UTC m=+173.355868046" observedRunningTime="2026-06-02 15:26:47.540315207 +0000 UTC m=+174.146007902" watchObservedRunningTime="2026-06-02 15:26:47.626435758 +0000 UTC m=+174.232128474" Jun 02 15:26:48.096833 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.096796 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:48.097009 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.096847 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:48.102182 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.102158 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:48.161680 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.161643 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-ms4gg"] Jun 02 15:26:48.165165 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.165138 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.171527 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.171497 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 15:26:48.171527 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.171513 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 15:26:48.171749 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.171602 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 15:26:48.171749 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.171658 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 15:26:48.171971 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.171951 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dfmff\"" Jun 02 15:26:48.172088 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.172051 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 15:26:48.189027 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.188986 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-ms4gg"] Jun 02 15:26:48.260153 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.260124 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm"] Jun 02 15:26:48.263138 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.263113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.263263 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.263165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.263263 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.263214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj6pf\" (UniqueName: \"kubernetes.io/projected/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-kube-api-access-kj6pf\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.263263 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.263233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.263385 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.263273 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.265758 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.265738 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 15:26:48.266547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.266528 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6dkfq\"" Jun 02 15:26:48.266768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.266756 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 15:26:48.266932 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.266904 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 15:26:48.281041 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.281020 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l78xq"] Jun 02 15:26:48.284186 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.284165 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm"] Jun 02 15:26:48.284306 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.284293 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.292090 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.292074 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 15:26:48.292198 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.292182 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 15:26:48.295749 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.295733 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xvk85\"" Jun 02 15:26:48.300259 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.300235 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 15:26:48.364080 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364007 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj6pf\" (UniqueName: \"kubernetes.io/projected/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-kube-api-access-kj6pf\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.364080 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364050 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.364276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.364276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.364276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.364276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.364276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spl7t\" (UniqueName: \"kubernetes.io/projected/228f26aa-48ff-4037-a207-33f9a7d725b8-kube-api-access-spl7t\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-sys\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-wtmp\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-tls\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364456 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.364553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c49jn\" (UniqueName: \"kubernetes.io/projected/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-api-access-c49jn\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:48.364554 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228f26aa-48ff-4037-a207-33f9a7d725b8-metrics-client-ca\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:48.364634 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-tls podName:01afe4ea-87af-435d-8e46-b8ebd3f39e3d nodeName:}" failed. No retries permitted until 2026-06-02 15:26:48.864619439 +0000 UTC m=+175.470312114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-ms4gg" (UID: "01afe4ea-87af-435d-8e46-b8ebd3f39e3d") : secret "openshift-state-metrics-tls" not found Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-root\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364743 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.364785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.365073 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.364819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-textfile\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.365383 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.365364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.366906 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.366886 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.385045 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.385016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj6pf\" (UniqueName: \"kubernetes.io/projected/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-kube-api-access-kj6pf\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.465769 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.465733 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.465956 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.465782 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.465956 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.465907 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.465961 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.465991 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-spl7t\" (UniqueName: \"kubernetes.io/projected/228f26aa-48ff-4037-a207-33f9a7d725b8-kube-api-access-spl7t\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466021 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466059 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466052 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-sys\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466079 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-wtmp\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466129 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-tls\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466167 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c49jn\" (UniqueName: \"kubernetes.io/projected/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-api-access-c49jn\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466194 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228f26aa-48ff-4037-a207-33f9a7d725b8-metrics-client-ca\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466233 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466220 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466437 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466259 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-root\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466437 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466288 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466437 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466317 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-textfile\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466437 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:48.466422 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 15:26:48.466655 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:26:48.466488 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-tls podName:228f26aa-48ff-4037-a207-33f9a7d725b8 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:48.966468083 +0000 UTC m=+175.572160772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-tls") pod "node-exporter-l78xq" (UID: "228f26aa-48ff-4037-a207-33f9a7d725b8") : secret "node-exporter-tls" not found Jun 02 15:26:48.466655 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466655 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466499 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466701 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-textfile\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466723 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-root\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.466841 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466807 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.466891 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.466858 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-sys\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.467106 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.467082 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-wtmp\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.467220 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.467170 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.467349 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.467325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228f26aa-48ff-4037-a207-33f9a7d725b8-metrics-client-ca\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.469642 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.469619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.469915 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.469896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.470032 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.470013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.476610 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.476590 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spl7t\" (UniqueName: \"kubernetes.io/projected/228f26aa-48ff-4037-a207-33f9a7d725b8-kube-api-access-spl7t\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.476933 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.476914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c49jn\" (UniqueName: \"kubernetes.io/projected/aebc20e9-5c11-43b2-83bb-be6b9c50a52c-kube-api-access-c49jn\") pod \"kube-state-metrics-8469c486bb-kp7qm\" (UID: \"aebc20e9-5c11-43b2-83bb-be6b9c50a52c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.480623 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.480604 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pwpvj" Jun 02 15:26:48.529625 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.529592 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:26:48.573165 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.573136 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" Jun 02 15:26:48.762637 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.762602 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm"] Jun 02 15:26:48.767122 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:48.767091 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebc20e9_5c11_43b2_83bb_be6b9c50a52c.slice/crio-350ec5c58b84b02b22ec56683efaa408d3809e4b61f4fb786db7a17f5bf177b2 WatchSource:0}: Error finding container 350ec5c58b84b02b22ec56683efaa408d3809e4b61f4fb786db7a17f5bf177b2: Status 404 returned error can't find the container with id 350ec5c58b84b02b22ec56683efaa408d3809e4b61f4fb786db7a17f5bf177b2 Jun 02 15:26:48.871384 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.871346 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.874192 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.874169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01afe4ea-87af-435d-8e46-b8ebd3f39e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ms4gg\" (UID: \"01afe4ea-87af-435d-8e46-b8ebd3f39e3d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:48.972527 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.972439 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-tls\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:48.974927 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:48.974894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/228f26aa-48ff-4037-a207-33f9a7d725b8-node-exporter-tls\") pod \"node-exporter-l78xq\" (UID: \"228f26aa-48ff-4037-a207-33f9a7d725b8\") " pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:49.076803 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.076768 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" Jun 02 15:26:49.193831 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.193409 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l78xq" Jun 02 15:26:49.203897 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:49.203860 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228f26aa_48ff_4037_a207_33f9a7d725b8.slice/crio-6a62ad83c1baa1f05c3a699b10334411c9e5f6492724edd505e849d572f81753 WatchSource:0}: Error finding container 6a62ad83c1baa1f05c3a699b10334411c9e5f6492724edd505e849d572f81753: Status 404 returned error can't find the container with id 6a62ad83c1baa1f05c3a699b10334411c9e5f6492724edd505e849d572f81753 Jun 02 15:26:49.222887 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.222820 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-ms4gg"] Jun 02 15:26:49.226348 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:49.226308 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01afe4ea_87af_435d_8e46_b8ebd3f39e3d.slice/crio-6652e3c3067d67ff70ad593999a6ede7aa52afc749a22cbdfa09fbd083bda721 WatchSource:0}: Error finding container 6652e3c3067d67ff70ad593999a6ede7aa52afc749a22cbdfa09fbd083bda721: Status 404 returned error can't find the container with id 6652e3c3067d67ff70ad593999a6ede7aa52afc749a22cbdfa09fbd083bda721 Jun 02 15:26:49.262952 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.262925 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:26:49.268497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.268460 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.272852 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.272823 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 15:26:49.273734 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273483 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 15:26:49.273734 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273513 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 15:26:49.273734 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273590 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 15:26:49.273734 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273643 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 15:26:49.273734 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273680 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 15:26:49.273734 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273698 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 15:26:49.274053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.273808 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vspkp\"" Jun 02 15:26:49.274300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.274283 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 15:26:49.274656 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.274639 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 15:26:49.284659 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.284637 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:26:49.376804 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.376944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.376944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-config-out\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.376944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.376944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377149 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377149 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.376984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377149 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.377080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-web-config\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377296 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.377149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377296 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.377180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377296 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.377221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377447 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.377315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.377447 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.377349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskhz\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-kube-api-access-bskhz\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478243 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478158 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-web-config\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478243 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478234 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478255 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478284 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478336 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478358 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bskhz\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-kube-api-access-bskhz\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478389 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478418 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478457 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-config-out\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478480 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478509 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478542 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.478772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.478617 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.479138 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.479103 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.479424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.479404 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.479481 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.479402 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.481968 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.481781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.481968 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.481861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.483497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.483423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.483497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.483457 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.483497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.483474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.484142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.483779 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-config-out\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.484533 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.484390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.484979 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.484957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-web-config\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.485249 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.485228 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.491447 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.491422 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskhz\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-kube-api-access-bskhz\") pod \"alertmanager-main-0\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.528550 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.528518 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l78xq" event={"ID":"228f26aa-48ff-4037-a207-33f9a7d725b8","Type":"ContainerStarted","Data":"6a62ad83c1baa1f05c3a699b10334411c9e5f6492724edd505e849d572f81753"} Jun 02 15:26:49.530136 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.530100 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" event={"ID":"01afe4ea-87af-435d-8e46-b8ebd3f39e3d","Type":"ContainerStarted","Data":"a6637f5f39f6923b59c54f05ce3ac60294c38930d8c3529b76638295e4c7153d"} Jun 02 15:26:49.530136 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.530135 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" event={"ID":"01afe4ea-87af-435d-8e46-b8ebd3f39e3d","Type":"ContainerStarted","Data":"dd8d9fe8d01eef121db4bca2e42faf874b501071a2044618d09c0594340c4433"} Jun 02 15:26:49.530509 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.530150 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" event={"ID":"01afe4ea-87af-435d-8e46-b8ebd3f39e3d","Type":"ContainerStarted","Data":"6652e3c3067d67ff70ad593999a6ede7aa52afc749a22cbdfa09fbd083bda721"} Jun 02 15:26:49.531242 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.531216 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" event={"ID":"aebc20e9-5c11-43b2-83bb-be6b9c50a52c","Type":"ContainerStarted","Data":"350ec5c58b84b02b22ec56683efaa408d3809e4b61f4fb786db7a17f5bf177b2"} Jun 02 15:26:49.580041 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.580011 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:26:49.765543 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:49.765435 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:26:49.769592 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:49.769534 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc63755_47a1_4331_8a44_672dbeec3241.slice/crio-44e31f1db44f23bc98628a23e6c76f3f00928dfc271e4191bd3b46b21b9d8145 WatchSource:0}: Error finding container 44e31f1db44f23bc98628a23e6c76f3f00928dfc271e4191bd3b46b21b9d8145: Status 404 returned error can't find the container with id 44e31f1db44f23bc98628a23e6c76f3f00928dfc271e4191bd3b46b21b9d8145 Jun 02 15:26:50.537400 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:50.537361 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"44e31f1db44f23bc98628a23e6c76f3f00928dfc271e4191bd3b46b21b9d8145"} Jun 02 15:26:51.541889 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.541855 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994" exitCode=0 Jun 02 15:26:51.542326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.541942 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994"} Jun 02 15:26:51.544399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.544372 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" event={"ID":"01afe4ea-87af-435d-8e46-b8ebd3f39e3d","Type":"ContainerStarted","Data":"ed41bd1d08c15cbda062c1765369522bdea387ed2ab6d7ecf7901cd099672cee"} Jun 02 15:26:51.546464 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.546440 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" event={"ID":"aebc20e9-5c11-43b2-83bb-be6b9c50a52c","Type":"ContainerStarted","Data":"57e994eb950ccd1d9c77c249a78a821c9a8f1b735660cd231ae7e5a78a90781d"} Jun 02 15:26:51.546595 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.546471 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" event={"ID":"aebc20e9-5c11-43b2-83bb-be6b9c50a52c","Type":"ContainerStarted","Data":"2ab95419139a9bbcc2551226e8db20db6c5256ab0aff24a3eb15dff70872f24f"} Jun 02 15:26:51.546595 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.546482 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" event={"ID":"aebc20e9-5c11-43b2-83bb-be6b9c50a52c","Type":"ContainerStarted","Data":"e71234fd7c174134859736a0ffaa3eb84fb9458336347ec3a41b29f76770e963"} Jun 02 15:26:51.547923 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.547899 2579 generic.go:358] "Generic (PLEG): container finished" podID="228f26aa-48ff-4037-a207-33f9a7d725b8" containerID="4c84e768a6d549a809aac6fc6e61ad62ae283f7913a07cbf739934b28fb8ae92" exitCode=0 Jun 02 15:26:51.548067 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.547951 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l78xq" event={"ID":"228f26aa-48ff-4037-a207-33f9a7d725b8","Type":"ContainerDied","Data":"4c84e768a6d549a809aac6fc6e61ad62ae283f7913a07cbf739934b28fb8ae92"} Jun 02 15:26:51.655504 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.655420 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kp7qm" podStartSLOduration=1.282651704 podStartE2EDuration="3.655401671s" podCreationTimestamp="2026-06-02 15:26:48 +0000 UTC" firstStartedPulling="2026-06-02 15:26:48.769636657 +0000 UTC m=+175.375329328" lastFinishedPulling="2026-06-02 15:26:51.1423866 +0000 UTC m=+177.748079295" observedRunningTime="2026-06-02 15:26:51.625383622 +0000 UTC m=+178.231076318" watchObservedRunningTime="2026-06-02 15:26:51.655401671 +0000 UTC m=+178.261094366" Jun 02 15:26:51.679524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:51.679470 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-ms4gg" podStartSLOduration=1.89207117 podStartE2EDuration="3.679454407s" podCreationTimestamp="2026-06-02 15:26:48 +0000 UTC" firstStartedPulling="2026-06-02 15:26:49.355101132 +0000 UTC m=+175.960793810" lastFinishedPulling="2026-06-02 15:26:51.142484368 +0000 UTC m=+177.748177047" observedRunningTime="2026-06-02 15:26:51.677593935 +0000 UTC m=+178.283286642" watchObservedRunningTime="2026-06-02 15:26:51.679454407 +0000 UTC m=+178.285147100" Jun 02 15:26:52.555353 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:52.555305 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l78xq" event={"ID":"228f26aa-48ff-4037-a207-33f9a7d725b8","Type":"ContainerStarted","Data":"11bbde880496642d5be0454969fd475a2b9b4f720f3c27a039e02889a4948651"} Jun 02 15:26:52.555831 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:52.555362 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l78xq" event={"ID":"228f26aa-48ff-4037-a207-33f9a7d725b8","Type":"ContainerStarted","Data":"3af6966e6853bb329d98dc120325dcfb3fbc165a30a0a7386ec718df51106222"} Jun 02 15:26:52.587944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:52.587889 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l78xq" podStartSLOduration=2.651202607 podStartE2EDuration="4.587875579s" podCreationTimestamp="2026-06-02 15:26:48 +0000 UTC" firstStartedPulling="2026-06-02 15:26:49.205974058 +0000 UTC m=+175.811666748" lastFinishedPulling="2026-06-02 15:26:51.142647045 +0000 UTC m=+177.748339720" observedRunningTime="2026-06-02 15:26:52.585410663 +0000 UTC m=+179.191103357" watchObservedRunningTime="2026-06-02 15:26:52.587875579 +0000 UTC m=+179.193568272" Jun 02 15:26:53.797261 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.797223 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f8f5556dc-wmr6k"] Jun 02 15:26:53.802167 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.802147 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.811310 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.811288 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:26:53.815556 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.815534 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8f5556dc-wmr6k"] Jun 02 15:26:53.922256 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vp94\" (UniqueName: \"kubernetes.io/projected/62103259-48b8-437e-b3bb-5564a02d2f40-kube-api-access-5vp94\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.922399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-service-ca\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.922399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-serving-cert\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.922399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-console-config\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.922532 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-trusted-ca-bundle\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.922532 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922444 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-oauth-serving-cert\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:53.922532 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:53.922484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-oauth-config\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026042 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026004 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vp94\" (UniqueName: \"kubernetes.io/projected/62103259-48b8-437e-b3bb-5564a02d2f40-kube-api-access-5vp94\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026055 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-service-ca\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026080 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-serving-cert\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026107 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-console-config\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026151 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-trusted-ca-bundle\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026191 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-oauth-serving-cert\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.026290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.026266 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-oauth-config\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.028304 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.028273 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-service-ca\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.029477 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.029410 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-oauth-config\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.029627 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.029557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-oauth-serving-cert\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.029777 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.029755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-console-config\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.032021 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.031998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-serving-cert\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.039057 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.039024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vp94\" (UniqueName: \"kubernetes.io/projected/62103259-48b8-437e-b3bb-5564a02d2f40-kube-api-access-5vp94\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.039166 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.039087 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:26:54.039769 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.039749 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-trusted-ca-bundle\") pod \"console-7f8f5556dc-wmr6k\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:54.113359 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:54.113309 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:26:58.848007 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:58.846587 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f8f5556dc-wmr6k"] Jun 02 15:26:58.852647 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:26:58.852622 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62103259_48b8_437e_b3bb_5564a02d2f40.slice/crio-8d52d258891f3561fed7a3c4a3cdcca419575131698d61475c6a44331697a539 WatchSource:0}: Error finding container 8d52d258891f3561fed7a3c4a3cdcca419575131698d61475c6a44331697a539: Status 404 returned error can't find the container with id 8d52d258891f3561fed7a3c4a3cdcca419575131698d61475c6a44331697a539 Jun 02 15:26:59.578235 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.578194 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-b77m2" event={"ID":"b89cb5b3-671a-4887-9c8b-fa5a229766d9","Type":"ContainerStarted","Data":"3ce26d7cd378183ef343cb244995e66f631dca1e3b988490ca07be91287c762f"} Jun 02 15:26:59.578417 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.578387 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:59.580483 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.580332 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f5556dc-wmr6k" event={"ID":"62103259-48b8-437e-b3bb-5564a02d2f40","Type":"ContainerStarted","Data":"b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853"} Jun 02 15:26:59.580483 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.580364 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f5556dc-wmr6k" event={"ID":"62103259-48b8-437e-b3bb-5564a02d2f40","Type":"ContainerStarted","Data":"8d52d258891f3561fed7a3c4a3cdcca419575131698d61475c6a44331697a539"} Jun 02 15:26:59.593162 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.593121 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-b77m2" Jun 02 15:26:59.625994 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.625937 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-b77m2" podStartSLOduration=2.129001022 podStartE2EDuration="22.62591661s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:38.299864037 +0000 UTC m=+164.905556712" lastFinishedPulling="2026-06-02 15:26:58.796779629 +0000 UTC m=+185.402472300" observedRunningTime="2026-06-02 15:26:59.601798763 +0000 UTC m=+186.207491457" watchObservedRunningTime="2026-06-02 15:26:59.62591661 +0000 UTC m=+186.231609307" Jun 02 15:26:59.658352 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:26:59.658270 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f8f5556dc-wmr6k" podStartSLOduration=6.658254264 podStartE2EDuration="6.658254264s" podCreationTimestamp="2026-06-02 15:26:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:59.655836421 +0000 UTC m=+186.261529116" watchObservedRunningTime="2026-06-02 15:26:59.658254264 +0000 UTC m=+186.263946958" Jun 02 15:27:00.585662 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:00.585631 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8"} Jun 02 15:27:00.586012 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:00.585672 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a"} Jun 02 15:27:00.586012 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:00.585685 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42"} Jun 02 15:27:01.593176 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:01.593139 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd"} Jun 02 15:27:01.593176 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:01.593181 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955"} Jun 02 15:27:02.599318 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:02.599276 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerStarted","Data":"1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a"} Jun 02 15:27:02.627685 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:02.627647 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" podUID="aec0986f-11f2-4310-bdaf-3101385d4d2b" containerName="registry" containerID="cri-o://33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6" gracePeriod=30 Jun 02 15:27:02.640152 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:02.640099 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.333896232 podStartE2EDuration="13.640079849s" podCreationTimestamp="2026-06-02 15:26:49 +0000 UTC" firstStartedPulling="2026-06-02 15:26:49.77146424 +0000 UTC m=+176.377156927" lastFinishedPulling="2026-06-02 15:27:02.07764787 +0000 UTC m=+188.683340544" observedRunningTime="2026-06-02 15:27:02.638640938 +0000 UTC m=+189.244333632" watchObservedRunningTime="2026-06-02 15:27:02.640079849 +0000 UTC m=+189.245772542" Jun 02 15:27:02.907102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:02.907078 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:27:03.018078 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018045 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-bound-sa-token\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018103 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thcg5\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-kube-api-access-thcg5\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018144 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-trusted-ca\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018173 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-installation-pull-secrets\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018216 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-certificates\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018496 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018297 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-image-registry-private-configuration\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018496 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018321 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018496 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018358 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aec0986f-11f2-4310-bdaf-3101385d4d2b-ca-trust-extracted\") pod \"aec0986f-11f2-4310-bdaf-3101385d4d2b\" (UID: \"aec0986f-11f2-4310-bdaf-3101385d4d2b\") " Jun 02 15:27:03.018682 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.018562 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:03.019162 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.019114 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:03.021290 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.021259 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:03.021972 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.021864 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:03.021972 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.021889 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:03.021972 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.021934 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-kube-api-access-thcg5" (OuterVolumeSpecName: "kube-api-access-thcg5") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "kube-api-access-thcg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:03.023394 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.023372 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:03.029670 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.029642 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec0986f-11f2-4310-bdaf-3101385d4d2b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aec0986f-11f2-4310-bdaf-3101385d4d2b" (UID: "aec0986f-11f2-4310-bdaf-3101385d4d2b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:27:03.119787 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119757 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-image-registry-private-configuration\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119789 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-tls\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119803 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aec0986f-11f2-4310-bdaf-3101385d4d2b-ca-trust-extracted\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119815 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-bound-sa-token\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119829 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thcg5\" (UniqueName: \"kubernetes.io/projected/aec0986f-11f2-4310-bdaf-3101385d4d2b-kube-api-access-thcg5\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119844 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-trusted-ca\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119857 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aec0986f-11f2-4310-bdaf-3101385d4d2b-installation-pull-secrets\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.119898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.119871 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aec0986f-11f2-4310-bdaf-3101385d4d2b-registry-certificates\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:03.604398 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.604355 2579 generic.go:358] "Generic (PLEG): container finished" podID="aec0986f-11f2-4310-bdaf-3101385d4d2b" containerID="33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6" exitCode=0 Jun 02 15:27:03.604985 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.604425 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" Jun 02 15:27:03.604985 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.604446 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" event={"ID":"aec0986f-11f2-4310-bdaf-3101385d4d2b","Type":"ContainerDied","Data":"33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6"} Jun 02 15:27:03.604985 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.604499 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78dff7b668-4shrx" event={"ID":"aec0986f-11f2-4310-bdaf-3101385d4d2b","Type":"ContainerDied","Data":"4918b3841c57e1d3fd8aacefbdecaad54383fa96e092de246233340133926b3e"} Jun 02 15:27:03.604985 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.604521 2579 scope.go:117] "RemoveContainer" containerID="33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6" Jun 02 15:27:03.614368 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.614343 2579 scope.go:117] "RemoveContainer" containerID="33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6" Jun 02 15:27:03.614695 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:27:03.614658 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6\": container with ID starting with 33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6 not found: ID does not exist" containerID="33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6" Jun 02 15:27:03.614780 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.614695 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6"} err="failed to get container status \"33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6\": rpc error: code = NotFound desc = could not find container \"33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6\": container with ID starting with 33f594ebab76b8238c684740bef0a8e970ece4f055f17ea5550099fc7ab977b6 not found: ID does not exist" Jun 02 15:27:03.631229 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.631207 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78dff7b668-4shrx"] Jun 02 15:27:03.638518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:03.638489 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78dff7b668-4shrx"] Jun 02 15:27:04.032760 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:04.032686 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aec0986f-11f2-4310-bdaf-3101385d4d2b" path="/var/lib/kubelet/pods/aec0986f-11f2-4310-bdaf-3101385d4d2b/volumes" Jun 02 15:27:04.114308 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:04.114270 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:27:04.114476 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:04.114321 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:27:04.119620 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:04.119593 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:27:04.613708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:04.613677 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:27:04.673382 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:04.673347 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86cd695c95-zqj5h"] Jun 02 15:27:29.698674 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:29.698628 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-86cd695c95-zqj5h" podUID="7ea14e64-23d4-491b-abbd-12b111d8d1f9" containerName="console" containerID="cri-o://dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93" gracePeriod=15 Jun 02 15:27:29.961750 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:29.961721 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86cd695c95-zqj5h_7ea14e64-23d4-491b-abbd-12b111d8d1f9/console/0.log" Jun 02 15:27:29.961863 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:29.961781 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:27:30.053851 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.053823 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-service-ca\") pod \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " Jun 02 15:27:30.054011 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.053876 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-oauth-serving-cert\") pod \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " Jun 02 15:27:30.054011 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.053938 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-serving-cert\") pod \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " Jun 02 15:27:30.054011 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.053958 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bckr5\" (UniqueName: \"kubernetes.io/projected/7ea14e64-23d4-491b-abbd-12b111d8d1f9-kube-api-access-bckr5\") pod \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " Jun 02 15:27:30.054011 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.053985 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-oauth-config\") pod \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " Jun 02 15:27:30.054179 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.054011 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-config\") pod \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\" (UID: \"7ea14e64-23d4-491b-abbd-12b111d8d1f9\") " Jun 02 15:27:30.054273 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.054246 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ea14e64-23d4-491b-abbd-12b111d8d1f9" (UID: "7ea14e64-23d4-491b-abbd-12b111d8d1f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:30.054347 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.054258 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ea14e64-23d4-491b-abbd-12b111d8d1f9" (UID: "7ea14e64-23d4-491b-abbd-12b111d8d1f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:30.054494 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.054469 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-config" (OuterVolumeSpecName: "console-config") pod "7ea14e64-23d4-491b-abbd-12b111d8d1f9" (UID: "7ea14e64-23d4-491b-abbd-12b111d8d1f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:30.056279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.056247 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ea14e64-23d4-491b-abbd-12b111d8d1f9" (UID: "7ea14e64-23d4-491b-abbd-12b111d8d1f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:30.056279 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.056264 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ea14e64-23d4-491b-abbd-12b111d8d1f9" (UID: "7ea14e64-23d4-491b-abbd-12b111d8d1f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:30.056415 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.056331 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ea14e64-23d4-491b-abbd-12b111d8d1f9-kube-api-access-bckr5" (OuterVolumeSpecName: "kube-api-access-bckr5") pod "7ea14e64-23d4-491b-abbd-12b111d8d1f9" (UID: "7ea14e64-23d4-491b-abbd-12b111d8d1f9"). InnerVolumeSpecName "kube-api-access-bckr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:30.155401 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.155372 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-serving-cert\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:30.155401 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.155397 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bckr5\" (UniqueName: \"kubernetes.io/projected/7ea14e64-23d4-491b-abbd-12b111d8d1f9-kube-api-access-bckr5\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:30.155401 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.155406 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-oauth-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:30.155686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.155415 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-console-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:30.155686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.155424 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-service-ca\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:30.155686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.155432 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ea14e64-23d4-491b-abbd-12b111d8d1f9-oauth-serving-cert\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:27:30.686227 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.686201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86cd695c95-zqj5h_7ea14e64-23d4-491b-abbd-12b111d8d1f9/console/0.log" Jun 02 15:27:30.686407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.686243 2579 generic.go:358] "Generic (PLEG): container finished" podID="7ea14e64-23d4-491b-abbd-12b111d8d1f9" containerID="dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93" exitCode=2 Jun 02 15:27:30.686407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.686314 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cd695c95-zqj5h" Jun 02 15:27:30.686407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.686337 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cd695c95-zqj5h" event={"ID":"7ea14e64-23d4-491b-abbd-12b111d8d1f9","Type":"ContainerDied","Data":"dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93"} Jun 02 15:27:30.686407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.686385 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cd695c95-zqj5h" event={"ID":"7ea14e64-23d4-491b-abbd-12b111d8d1f9","Type":"ContainerDied","Data":"e24927afed584388e8e1b00d029c385b1fde1dddacc01aa0770c532e5b1a337a"} Jun 02 15:27:30.686407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.686407 2579 scope.go:117] "RemoveContainer" containerID="dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93" Jun 02 15:27:30.694754 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.694736 2579 scope.go:117] "RemoveContainer" containerID="dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93" Jun 02 15:27:30.695017 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:27:30.694995 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93\": container with ID starting with dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93 not found: ID does not exist" containerID="dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93" Jun 02 15:27:30.695095 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.695024 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93"} err="failed to get container status \"dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93\": rpc error: code = NotFound desc = could not find container \"dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93\": container with ID starting with dbd2b2171cb1fc68f1fb17a493eedb8725a9e4d31f1f5d0227311e4b77943d93 not found: ID does not exist" Jun 02 15:27:30.712145 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.712122 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86cd695c95-zqj5h"] Jun 02 15:27:30.715791 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:30.715773 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86cd695c95-zqj5h"] Jun 02 15:27:32.034373 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:32.034293 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ea14e64-23d4-491b-abbd-12b111d8d1f9" path="/var/lib/kubelet/pods/7ea14e64-23d4-491b-abbd-12b111d8d1f9/volumes" Jun 02 15:27:36.704306 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:36.704271 2579 generic.go:358] "Generic (PLEG): container finished" podID="9bfdac31-e35f-456d-bb99-ac110f9d57dc" containerID="554b32a76de661fc3b34fc8d4bdc2cca7568ce07f4698a5da0d0a0412f593c3d" exitCode=0 Jun 02 15:27:36.704711 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:36.704344 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-56xdk" event={"ID":"9bfdac31-e35f-456d-bb99-ac110f9d57dc","Type":"ContainerDied","Data":"554b32a76de661fc3b34fc8d4bdc2cca7568ce07f4698a5da0d0a0412f593c3d"} Jun 02 15:27:36.704711 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:36.704684 2579 scope.go:117] "RemoveContainer" containerID="554b32a76de661fc3b34fc8d4bdc2cca7568ce07f4698a5da0d0a0412f593c3d" Jun 02 15:27:37.709097 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:27:37.709059 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-56xdk" event={"ID":"9bfdac31-e35f-456d-bb99-ac110f9d57dc","Type":"ContainerStarted","Data":"474a47b7144029c3f0a0fdbb24556a2fcf9e99fdf6cc34e22e4c3362e4e7b920"} Jun 02 15:28:05.755548 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:05.755507 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:28:05.757890 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:05.757868 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/083a58df-dc26-4e68-b6b7-0b823ff0a87f-metrics-certs\") pod \"network-metrics-daemon-45929\" (UID: \"083a58df-dc26-4e68-b6b7-0b823ff0a87f\") " pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:28:05.934457 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:05.934427 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8csp4\"" Jun 02 15:28:05.941693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:05.941674 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45929" Jun 02 15:28:06.067446 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:06.067422 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45929"] Jun 02 15:28:06.069990 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:28:06.069967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a58df_dc26_4e68_b6b7_0b823ff0a87f.slice/crio-f858232c8945da85fc1738a5b92814430b2df4689d660ca8607e10e2d77e3da3 WatchSource:0}: Error finding container f858232c8945da85fc1738a5b92814430b2df4689d660ca8607e10e2d77e3da3: Status 404 returned error can't find the container with id f858232c8945da85fc1738a5b92814430b2df4689d660ca8607e10e2d77e3da3 Jun 02 15:28:06.800835 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:06.800791 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45929" event={"ID":"083a58df-dc26-4e68-b6b7-0b823ff0a87f","Type":"ContainerStarted","Data":"f858232c8945da85fc1738a5b92814430b2df4689d660ca8607e10e2d77e3da3"} Jun 02 15:28:07.810394 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:07.810312 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45929" event={"ID":"083a58df-dc26-4e68-b6b7-0b823ff0a87f","Type":"ContainerStarted","Data":"1097d280eef7c7efc413a657cb99ff3d54d7b76eab2f7de443a504b124d3442a"} Jun 02 15:28:07.810394 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:07.810349 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45929" event={"ID":"083a58df-dc26-4e68-b6b7-0b823ff0a87f","Type":"ContainerStarted","Data":"323fc66f2b8611f7a74c16af6eddeebb00c12775e6f92a43baf602000d0fb258"} Jun 02 15:28:07.834712 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:07.834664 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-45929" podStartSLOduration=252.446213084 podStartE2EDuration="4m13.834648531s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:28:06.071553806 +0000 UTC m=+252.677246477" lastFinishedPulling="2026-06-02 15:28:07.459989253 +0000 UTC m=+254.065681924" observedRunningTime="2026-06-02 15:28:07.833300928 +0000 UTC m=+254.438993622" watchObservedRunningTime="2026-06-02 15:28:07.834648531 +0000 UTC m=+254.440341223" Jun 02 15:28:08.883187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883156 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:28:08.883756 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883608 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="alertmanager" containerID="cri-o://f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42" gracePeriod=120 Jun 02 15:28:08.883756 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883645 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-metric" containerID="cri-o://aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd" gracePeriod=120 Jun 02 15:28:08.883756 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883700 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="prom-label-proxy" containerID="cri-o://1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a" gracePeriod=120 Jun 02 15:28:08.883756 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883645 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-web" containerID="cri-o://bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8" gracePeriod=120 Jun 02 15:28:08.884029 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883648 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="config-reloader" containerID="cri-o://a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a" gracePeriod=120 Jun 02 15:28:08.884029 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:08.883709 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy" containerID="cri-o://046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955" gracePeriod=120 Jun 02 15:28:09.819697 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819660 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a" exitCode=0 Jun 02 15:28:09.819697 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819685 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd" exitCode=0 Jun 02 15:28:09.819697 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819691 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955" exitCode=0 Jun 02 15:28:09.819697 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819697 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a" exitCode=0 Jun 02 15:28:09.819697 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819702 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42" exitCode=0 Jun 02 15:28:09.819965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819734 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a"} Jun 02 15:28:09.819965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819769 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd"} Jun 02 15:28:09.819965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819779 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955"} Jun 02 15:28:09.819965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819787 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a"} Jun 02 15:28:09.819965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:09.819796 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42"} Jun 02 15:28:10.129941 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.129918 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:10.295082 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295045 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-config-out\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295083 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bskhz\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-kube-api-access-bskhz\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295126 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-config-volume\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295152 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295178 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-cluster-tls-config\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295205 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-main-db\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295252 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295292 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-metrics-client-ca\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295322 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-web-config\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295352 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-web\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295387 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-trusted-ca-bundle\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295426 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-main-tls\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295491 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295450 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-tls-assets\") pod \"2bc63755-47a1-4331-8a44-672dbeec3241\" (UID: \"2bc63755-47a1-4331-8a44-672dbeec3241\") " Jun 02 15:28:10.295844 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295562 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:28:10.295844 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.295744 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-main-db\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.296102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.296072 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:10.298367 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.298161 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:28:10.298510 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.298477 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:10.298662 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.298644 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-config-volume" (OuterVolumeSpecName: "config-volume") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.299170 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.299143 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.299257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.299188 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.299257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.299206 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-kube-api-access-bskhz" (OuterVolumeSpecName: "kube-api-access-bskhz") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "kube-api-access-bskhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:28:10.299607 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.299556 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-config-out" (OuterVolumeSpecName: "config-out") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:28:10.300399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.300378 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.300744 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.300722 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.303344 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.303220 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.309701 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.309677 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-web-config" (OuterVolumeSpecName: "web-config") pod "2bc63755-47a1-4331-8a44-672dbeec3241" (UID: "2bc63755-47a1-4331-8a44-672dbeec3241"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396605 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-web-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396646 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396658 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396668 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-main-tls\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396677 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-tls-assets\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396686 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bc63755-47a1-4331-8a44-672dbeec3241-config-out\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396695 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bskhz\" (UniqueName: \"kubernetes.io/projected/2bc63755-47a1-4331-8a44-672dbeec3241-kube-api-access-bskhz\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.396693 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396703 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-config-volume\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.397030 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396712 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.397030 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396721 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-cluster-tls-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.397030 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396731 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bc63755-47a1-4331-8a44-672dbeec3241-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.397030 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.396741 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bc63755-47a1-4331-8a44-672dbeec3241-metrics-client-ca\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:10.825630 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.825514 2579 generic.go:358] "Generic (PLEG): container finished" podID="2bc63755-47a1-4331-8a44-672dbeec3241" containerID="bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8" exitCode=0 Jun 02 15:28:10.825630 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.825604 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8"} Jun 02 15:28:10.825790 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.825641 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:10.825790 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.825649 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bc63755-47a1-4331-8a44-672dbeec3241","Type":"ContainerDied","Data":"44e31f1db44f23bc98628a23e6c76f3f00928dfc271e4191bd3b46b21b9d8145"} Jun 02 15:28:10.825790 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.825670 2579 scope.go:117] "RemoveContainer" containerID="1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a" Jun 02 15:28:10.832817 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.832797 2579 scope.go:117] "RemoveContainer" containerID="aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd" Jun 02 15:28:10.840098 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.840080 2579 scope.go:117] "RemoveContainer" containerID="046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955" Jun 02 15:28:10.847737 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.847723 2579 scope.go:117] "RemoveContainer" containerID="bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8" Jun 02 15:28:10.852697 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.852674 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:28:10.857340 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.857301 2579 scope.go:117] "RemoveContainer" containerID="a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a" Jun 02 15:28:10.860787 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.860763 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:28:10.869508 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.869486 2579 scope.go:117] "RemoveContainer" containerID="f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42" Jun 02 15:28:10.876033 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.876016 2579 scope.go:117] "RemoveContainer" containerID="90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994" Jun 02 15:28:10.882511 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.882494 2579 scope.go:117] "RemoveContainer" containerID="1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a" Jun 02 15:28:10.882771 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.882751 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a\": container with ID starting with 1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a not found: ID does not exist" containerID="1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a" Jun 02 15:28:10.882845 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.882783 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a"} err="failed to get container status \"1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a\": rpc error: code = NotFound desc = could not find container \"1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a\": container with ID starting with 1452b46311e7091fcdc31919b4e98430d6af3d0b0b2c01ef924d7e3488db908a not found: ID does not exist" Jun 02 15:28:10.882845 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.882809 2579 scope.go:117] "RemoveContainer" containerID="aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd" Jun 02 15:28:10.883072 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.883055 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd\": container with ID starting with aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd not found: ID does not exist" containerID="aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd" Jun 02 15:28:10.883112 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883078 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd"} err="failed to get container status \"aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd\": rpc error: code = NotFound desc = could not find container \"aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd\": container with ID starting with aefe5a51db972f66c2bfbafdf135d13e5ee83cb6b69708bda0b420f8b3203afd not found: ID does not exist" Jun 02 15:28:10.883112 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883093 2579 scope.go:117] "RemoveContainer" containerID="046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955" Jun 02 15:28:10.883320 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.883303 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955\": container with ID starting with 046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955 not found: ID does not exist" containerID="046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955" Jun 02 15:28:10.883364 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883324 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955"} err="failed to get container status \"046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955\": rpc error: code = NotFound desc = could not find container \"046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955\": container with ID starting with 046d2bd37e7148b544c4185945af7468a436d3b5154a6c0466b8c9e03b9cb955 not found: ID does not exist" Jun 02 15:28:10.883364 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883338 2579 scope.go:117] "RemoveContainer" containerID="bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8" Jun 02 15:28:10.883529 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.883511 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8\": container with ID starting with bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8 not found: ID does not exist" containerID="bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8" Jun 02 15:28:10.883603 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883536 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8"} err="failed to get container status \"bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8\": rpc error: code = NotFound desc = could not find container \"bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8\": container with ID starting with bd4824b57bcc0cab27d75053c4db6d81cfb4d5a5ec93e8a3a7abc51b16ce25f8 not found: ID does not exist" Jun 02 15:28:10.883603 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883557 2579 scope.go:117] "RemoveContainer" containerID="a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a" Jun 02 15:28:10.883803 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.883784 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a\": container with ID starting with a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a not found: ID does not exist" containerID="a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a" Jun 02 15:28:10.883841 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883806 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a"} err="failed to get container status \"a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a\": rpc error: code = NotFound desc = could not find container \"a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a\": container with ID starting with a17898c4c5e56de33e8d548c2ea97a52eda7273a14090fab801278592b07862a not found: ID does not exist" Jun 02 15:28:10.883841 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883819 2579 scope.go:117] "RemoveContainer" containerID="f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42" Jun 02 15:28:10.883994 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.883971 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42\": container with ID starting with f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42 not found: ID does not exist" containerID="f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42" Jun 02 15:28:10.884035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.883999 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42"} err="failed to get container status \"f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42\": rpc error: code = NotFound desc = could not find container \"f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42\": container with ID starting with f31c3e98061501824ebbfcaa43e6e1b2f1268b591c812861f7a437d5d7c87a42 not found: ID does not exist" Jun 02 15:28:10.884035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.884012 2579 scope.go:117] "RemoveContainer" containerID="90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994" Jun 02 15:28:10.884162 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:10.884148 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994\": container with ID starting with 90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994 not found: ID does not exist" containerID="90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994" Jun 02 15:28:10.884215 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.884168 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994"} err="failed to get container status \"90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994\": rpc error: code = NotFound desc = could not find container \"90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994\": container with ID starting with 90468662e2c923415ab9c919c9643f2e21599ebe3014bde1160e3b85ab82c994 not found: ID does not exist" Jun 02 15:28:10.905967 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.905940 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:28:10.906252 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906239 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="config-reloader" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906254 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="config-reloader" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906262 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-web" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906268 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-web" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906277 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906282 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906290 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ea14e64-23d4-491b-abbd-12b111d8d1f9" containerName="console" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906295 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ea14e64-23d4-491b-abbd-12b111d8d1f9" containerName="console" Jun 02 15:28:10.906302 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906302 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-metric" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906306 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-metric" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906317 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="prom-label-proxy" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906321 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="prom-label-proxy" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906327 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec0986f-11f2-4310-bdaf-3101385d4d2b" containerName="registry" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906332 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec0986f-11f2-4310-bdaf-3101385d4d2b" containerName="registry" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906338 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="init-config-reloader" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906344 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="init-config-reloader" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906350 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="alertmanager" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906356 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="alertmanager" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906398 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="aec0986f-11f2-4310-bdaf-3101385d4d2b" containerName="registry" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906406 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="config-reloader" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906412 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ea14e64-23d4-491b-abbd-12b111d8d1f9" containerName="console" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906418 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-web" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906424 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906430 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="kube-rbac-proxy-metric" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906435 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="prom-label-proxy" Jun 02 15:28:10.906547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.906441 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" containerName="alertmanager" Jun 02 15:28:10.909783 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.909768 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:10.914366 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.914345 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 15:28:10.914547 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.914529 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 15:28:10.914752 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.914666 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 15:28:10.914826 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.914802 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 15:28:10.915407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.915371 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 15:28:10.915507 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.915423 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 15:28:10.915507 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.915432 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 15:28:10.915775 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.915758 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vspkp\"" Jun 02 15:28:10.916050 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.915809 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 15:28:10.922798 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.922780 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 15:28:10.950475 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:10.950452 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:28:11.001040 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-web-config\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001523 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77dtv\" (UniqueName: \"kubernetes.io/projected/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-kube-api-access-77dtv\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001523 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.001523 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.001414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-config-out\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.101701 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.101679 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-config-out\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.101819 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.101708 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.101819 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.101737 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.101985 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.101965 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102058 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102032 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102333 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102306 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102442 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102357 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102442 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102403 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102555 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102459 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102690 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102673 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.102839 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102824 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-web-config\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.103000 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.102984 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77dtv\" (UniqueName: \"kubernetes.io/projected/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-kube-api-access-77dtv\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.103117 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.103102 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.103250 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.103226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.103331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.103155 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.103690 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.103671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.104824 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.104797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-config-out\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.105054 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.105013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.105516 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.105486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.105516 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.105486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.106061 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.106037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.106234 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.106216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.106407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.106391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.106619 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.106600 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.107139 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.107121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-web-config\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.113954 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.113935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77dtv\" (UniqueName: \"kubernetes.io/projected/b844f6fa-6aab-4c2e-b9f7-76e1b81014b7-kube-api-access-77dtv\") pod \"alertmanager-main-0\" (UID: \"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.218316 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.218284 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 15:28:11.358520 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.358456 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 15:28:11.361237 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:28:11.361212 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb844f6fa_6aab_4c2e_b9f7_76e1b81014b7.slice/crio-46036edd0805b3f60750508008cd51571776c49c09b0fa2e01ea5bcfe680fde8 WatchSource:0}: Error finding container 46036edd0805b3f60750508008cd51571776c49c09b0fa2e01ea5bcfe680fde8: Status 404 returned error can't find the container with id 46036edd0805b3f60750508008cd51571776c49c09b0fa2e01ea5bcfe680fde8 Jun 02 15:28:11.829795 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.829759 2579 generic.go:358] "Generic (PLEG): container finished" podID="b844f6fa-6aab-4c2e-b9f7-76e1b81014b7" containerID="c9b5438a42fc7c2773829b170c680970b8169a7297ee5e7e363b15b753b0f3fe" exitCode=0 Jun 02 15:28:11.829946 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.829848 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerDied","Data":"c9b5438a42fc7c2773829b170c680970b8169a7297ee5e7e363b15b753b0f3fe"} Jun 02 15:28:11.829946 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:11.829892 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"46036edd0805b3f60750508008cd51571776c49c09b0fa2e01ea5bcfe680fde8"} Jun 02 15:28:12.030512 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.030484 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bc63755-47a1-4331-8a44-672dbeec3241" path="/var/lib/kubelet/pods/2bc63755-47a1-4331-8a44-672dbeec3241/volumes" Jun 02 15:28:12.836561 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.836524 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"27f06bc083d9d83a3a684ba54333d7cbb9c48d44bb4905d5ac78809c934bb40c"} Jun 02 15:28:12.836561 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.836562 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"95da39929548a27c58a014d9af6c52bf96ce4e94e440e73ccdf39a9a23bebc74"} Jun 02 15:28:12.837002 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.836586 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"158a67e2015f4b2c41a2fa35609ad47b87a17b800fe77420deda20325061ff0d"} Jun 02 15:28:12.837002 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.836606 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"a9fcd98f217091f04c48c4d8624e57bd7b857f11ae3c8dd21c61bf6a1b23f51a"} Jun 02 15:28:12.837002 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.836615 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"559dfca8d33e8d29a4568c0d020206b6f56bcce648a70005f99563c758b1958c"} Jun 02 15:28:12.837002 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.836627 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b844f6fa-6aab-4c2e-b9f7-76e1b81014b7","Type":"ContainerStarted","Data":"d0d2e384897796eb36a7e154253a48f68b00d9d7416297a5df4271bec55b474f"} Jun 02 15:28:12.886445 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.886403 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.886390619 podStartE2EDuration="2.886390619s" podCreationTimestamp="2026-06-02 15:28:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:28:12.884777433 +0000 UTC m=+259.490470136" watchObservedRunningTime="2026-06-02 15:28:12.886390619 +0000 UTC m=+259.492083312" Jun 02 15:28:12.976506 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.976469 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d858759b6-qqxs5"] Jun 02 15:28:12.978936 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.978912 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:12.982134 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.982116 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 15:28:12.982257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.982239 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h6wsq\"" Jun 02 15:28:12.982408 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.982395 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 15:28:12.982589 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.982562 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 15:28:12.982773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.982757 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 15:28:12.982887 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.982871 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 15:28:12.987902 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.987885 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 15:28:12.996210 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:12.996192 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d858759b6-qqxs5"] Jun 02 15:28:13.017094 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017177 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-serving-certs-ca-bundle\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017177 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-secret-telemeter-client\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017177 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-metrics-client-ca\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017268 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017268 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-telemeter-client-tls\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017268 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmm6\" (UniqueName: \"kubernetes.io/projected/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-kube-api-access-2pmm6\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.017358 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.017291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-federate-client-tls\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118340 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-serving-certs-ca-bundle\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118385 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-secret-telemeter-client\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118402 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-metrics-client-ca\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118451 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118484 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-telemeter-client-tls\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118505 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmm6\" (UniqueName: \"kubernetes.io/projected/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-kube-api-access-2pmm6\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118791 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118744 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-federate-client-tls\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.118835 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.118812 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.119170 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.119149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-metrics-client-ca\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.119259 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.119154 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-serving-certs-ca-bundle\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.119360 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.119338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.121089 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.121064 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-secret-telemeter-client\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.121180 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.121159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.121488 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.121466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-federate-client-tls\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.121696 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.121676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-telemeter-client-tls\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.129550 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.129531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmm6\" (UniqueName: \"kubernetes.io/projected/c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe-kube-api-access-2pmm6\") pod \"telemeter-client-d858759b6-qqxs5\" (UID: \"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe\") " pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.289308 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.289279 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" Jun 02 15:28:13.458193 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.458164 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d858759b6-qqxs5"] Jun 02 15:28:13.459907 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:28:13.459878 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ee13f8_357d_4f34_9cb6_03b7d4bd28fe.slice/crio-497bcf922679c33f1d41c97fba66d53b252088145e6a79708d4c3b8b985429ae WatchSource:0}: Error finding container 497bcf922679c33f1d41c97fba66d53b252088145e6a79708d4c3b8b985429ae: Status 404 returned error can't find the container with id 497bcf922679c33f1d41c97fba66d53b252088145e6a79708d4c3b8b985429ae Jun 02 15:28:13.840245 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:13.840213 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" event={"ID":"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe","Type":"ContainerStarted","Data":"497bcf922679c33f1d41c97fba66d53b252088145e6a79708d4c3b8b985429ae"} Jun 02 15:28:16.852513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:16.852478 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" event={"ID":"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe","Type":"ContainerStarted","Data":"3c03f9a677982e379859985930180905611747ed5d40c114277df83d9c41b18d"} Jun 02 15:28:16.852513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:16.852515 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" event={"ID":"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe","Type":"ContainerStarted","Data":"d2689280b9569d77aba41fd884a4e3a6f604c5b8d4a6c25180ae75fa7c609006"} Jun 02 15:28:16.852918 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:16.852525 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" event={"ID":"c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe","Type":"ContainerStarted","Data":"4148e86f54addc15ea7d85cc116391e536dfa05e19873f15a5e0ba03c58c2cf4"} Jun 02 15:28:16.891704 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:16.891655 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d858759b6-qqxs5" podStartSLOduration=2.436463537 podStartE2EDuration="4.891641667s" podCreationTimestamp="2026-06-02 15:28:12 +0000 UTC" firstStartedPulling="2026-06-02 15:28:13.461692576 +0000 UTC m=+260.067385248" lastFinishedPulling="2026-06-02 15:28:15.916870703 +0000 UTC m=+262.522563378" observedRunningTime="2026-06-02 15:28:16.889998715 +0000 UTC m=+263.495691407" watchObservedRunningTime="2026-06-02 15:28:16.891641667 +0000 UTC m=+263.497334360" Jun 02 15:28:17.573956 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.573924 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76d876cc5-52qq2"] Jun 02 15:28:17.576735 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.576711 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.588553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.588530 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d876cc5-52qq2"] Jun 02 15:28:17.659191 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-oauth-config\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.659365 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-console-config\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.659365 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-serving-cert\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.659365 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-oauth-serving-cert\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.659365 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-service-ca\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.659365 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cllkz\" (UniqueName: \"kubernetes.io/projected/4120b93e-70c7-4a43-8586-d1d276fba779-kube-api-access-cllkz\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.659365 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.659366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-trusted-ca-bundle\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.760645 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760611 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-oauth-config\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.760810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760656 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-console-config\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.760810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760690 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-serving-cert\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.760810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760718 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-oauth-serving-cert\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.760810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760757 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-service-ca\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.760810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760782 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cllkz\" (UniqueName: \"kubernetes.io/projected/4120b93e-70c7-4a43-8586-d1d276fba779-kube-api-access-cllkz\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.761028 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.760812 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-trusted-ca-bundle\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.761424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.761395 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-console-config\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.761536 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.761424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-oauth-serving-cert\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.761727 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.761534 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-service-ca\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.761984 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.761960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-trusted-ca-bundle\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.763345 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.763319 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-oauth-config\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.763452 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.763434 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-serving-cert\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.773502 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.773480 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cllkz\" (UniqueName: \"kubernetes.io/projected/4120b93e-70c7-4a43-8586-d1d276fba779-kube-api-access-cllkz\") pod \"console-76d876cc5-52qq2\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:17.886669 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:17.886620 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:18.014282 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:18.014259 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d876cc5-52qq2"] Jun 02 15:28:18.016421 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:28:18.016391 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4120b93e_70c7_4a43_8586_d1d276fba779.slice/crio-a678d52234c50579bdf8730e3e50bdcbd385bcff6442c9450d7ed741ff0a616a WatchSource:0}: Error finding container a678d52234c50579bdf8730e3e50bdcbd385bcff6442c9450d7ed741ff0a616a: Status 404 returned error can't find the container with id a678d52234c50579bdf8730e3e50bdcbd385bcff6442c9450d7ed741ff0a616a Jun 02 15:28:18.860006 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:18.859967 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d876cc5-52qq2" event={"ID":"4120b93e-70c7-4a43-8586-d1d276fba779","Type":"ContainerStarted","Data":"1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b"} Jun 02 15:28:18.860006 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:18.860011 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d876cc5-52qq2" event={"ID":"4120b93e-70c7-4a43-8586-d1d276fba779","Type":"ContainerStarted","Data":"a678d52234c50579bdf8730e3e50bdcbd385bcff6442c9450d7ed741ff0a616a"} Jun 02 15:28:18.880680 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:18.880630 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76d876cc5-52qq2" podStartSLOduration=1.8806126399999998 podStartE2EDuration="1.88061264s" podCreationTimestamp="2026-06-02 15:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:28:18.880403764 +0000 UTC m=+265.486096458" watchObservedRunningTime="2026-06-02 15:28:18.88061264 +0000 UTC m=+265.486305333" Jun 02 15:28:27.886902 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:27.886855 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:27.886902 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:27.886915 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:27.891906 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:27.891885 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:27.895604 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:27.895582 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:28:27.964592 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:27.964546 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8f5556dc-wmr6k"] Jun 02 15:28:52.985136 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:52.985101 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f8f5556dc-wmr6k" podUID="62103259-48b8-437e-b3bb-5564a02d2f40" containerName="console" containerID="cri-o://b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853" gracePeriod=15 Jun 02 15:28:53.221738 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.221717 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f8f5556dc-wmr6k_62103259-48b8-437e-b3bb-5564a02d2f40/console/0.log" Jun 02 15:28:53.221843 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.221778 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:28:53.353667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353636 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-oauth-serving-cert\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.353805 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353677 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vp94\" (UniqueName: \"kubernetes.io/projected/62103259-48b8-437e-b3bb-5564a02d2f40-kube-api-access-5vp94\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.353805 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353693 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-console-config\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.353805 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353712 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-serving-cert\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.353805 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353738 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-oauth-config\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.353805 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353765 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-trusted-ca-bundle\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.354094 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.353834 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-service-ca\") pod \"62103259-48b8-437e-b3bb-5564a02d2f40\" (UID: \"62103259-48b8-437e-b3bb-5564a02d2f40\") " Jun 02 15:28:53.354204 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.354089 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:53.354280 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.354183 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-console-config" (OuterVolumeSpecName: "console-config") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:53.354331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.354274 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-service-ca" (OuterVolumeSpecName: "service-ca") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:53.354331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.354289 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:53.356053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.356030 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:53.356331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.356305 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:53.356331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.356323 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62103259-48b8-437e-b3bb-5564a02d2f40-kube-api-access-5vp94" (OuterVolumeSpecName: "kube-api-access-5vp94") pod "62103259-48b8-437e-b3bb-5564a02d2f40" (UID: "62103259-48b8-437e-b3bb-5564a02d2f40"). InnerVolumeSpecName "kube-api-access-5vp94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:28:53.455123 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455079 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-oauth-serving-cert\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.455123 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455118 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vp94\" (UniqueName: \"kubernetes.io/projected/62103259-48b8-437e-b3bb-5564a02d2f40-kube-api-access-5vp94\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.455123 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455138 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-console-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.455339 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455148 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-serving-cert\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.455339 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455157 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62103259-48b8-437e-b3bb-5564a02d2f40-console-oauth-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.455339 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455166 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-trusted-ca-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.455339 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.455174 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62103259-48b8-437e-b3bb-5564a02d2f40-service-ca\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:28:53.900345 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.900318 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f8f5556dc-wmr6k_62103259-48b8-437e-b3bb-5564a02d2f40/console/0.log" Jun 02 15:28:53.900780 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.900761 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f8f5556dc-wmr6k_62103259-48b8-437e-b3bb-5564a02d2f40/console/0.log" Jun 02 15:28:53.907176 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.907154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:28:53.907585 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.907550 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:28:53.915503 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.915486 2579 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 15:28:53.965109 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.964952 2579 generic.go:358] "Generic (PLEG): container finished" podID="62103259-48b8-437e-b3bb-5564a02d2f40" containerID="b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853" exitCode=2 Jun 02 15:28:53.965109 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.965014 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f8f5556dc-wmr6k" Jun 02 15:28:53.965109 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.965032 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f5556dc-wmr6k" event={"ID":"62103259-48b8-437e-b3bb-5564a02d2f40","Type":"ContainerDied","Data":"b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853"} Jun 02 15:28:53.965109 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.965063 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f8f5556dc-wmr6k" event={"ID":"62103259-48b8-437e-b3bb-5564a02d2f40","Type":"ContainerDied","Data":"8d52d258891f3561fed7a3c4a3cdcca419575131698d61475c6a44331697a539"} Jun 02 15:28:53.965109 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.965081 2579 scope.go:117] "RemoveContainer" containerID="b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853" Jun 02 15:28:53.980335 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.973178 2579 scope.go:117] "RemoveContainer" containerID="b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853" Jun 02 15:28:53.980335 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:28:53.973408 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853\": container with ID starting with b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853 not found: ID does not exist" containerID="b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853" Jun 02 15:28:53.980335 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:53.973438 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853"} err="failed to get container status \"b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853\": rpc error: code = NotFound desc = could not find container \"b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853\": container with ID starting with b8cbd4e57c0a9b73c4257f7b2f1e0f5c6d802086280e9d25b504c00fcbab5853 not found: ID does not exist" Jun 02 15:28:54.012771 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:54.012749 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f8f5556dc-wmr6k"] Jun 02 15:28:54.026205 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:54.026182 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f8f5556dc-wmr6k"] Jun 02 15:28:54.034211 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:28:54.034187 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62103259-48b8-437e-b3bb-5564a02d2f40" path="/var/lib/kubelet/pods/62103259-48b8-437e-b3bb-5564a02d2f40/volumes" Jun 02 15:29:27.617194 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.617156 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb5ff4c98-9nktv"] Jun 02 15:29:27.617700 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.617682 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62103259-48b8-437e-b3bb-5564a02d2f40" containerName="console" Jun 02 15:29:27.617754 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.617702 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62103259-48b8-437e-b3bb-5564a02d2f40" containerName="console" Jun 02 15:29:27.617790 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.617767 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="62103259-48b8-437e-b3bb-5564a02d2f40" containerName="console" Jun 02 15:29:27.620945 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.620918 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.650205 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.650177 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb5ff4c98-9nktv"] Jun 02 15:29:27.713278 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.713240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f08024-2865-4637-859a-2fa127f291fa-console-serving-cert\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.713594 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.713548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f08024-2865-4637-859a-2fa127f291fa-console-oauth-config\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.713766 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.713751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-trusted-ca-bundle\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.713891 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.713879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdsc8\" (UniqueName: \"kubernetes.io/projected/14f08024-2865-4637-859a-2fa127f291fa-kube-api-access-sdsc8\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.714013 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.714000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-console-config\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.714126 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.714114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-oauth-serving-cert\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.714249 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.714237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-service-ca\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815421 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815390 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-service-ca\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815609 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815443 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f08024-2865-4637-859a-2fa127f291fa-console-serving-cert\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815609 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815566 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f08024-2865-4637-859a-2fa127f291fa-console-oauth-config\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815695 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815633 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-trusted-ca-bundle\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815695 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815657 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdsc8\" (UniqueName: \"kubernetes.io/projected/14f08024-2865-4637-859a-2fa127f291fa-kube-api-access-sdsc8\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815695 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815680 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-console-config\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.815823 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.815700 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-oauth-serving-cert\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.816168 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.816132 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-service-ca\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.816341 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.816321 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-oauth-serving-cert\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.816618 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.816596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-console-config\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.816795 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.816771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f08024-2865-4637-859a-2fa127f291fa-trusted-ca-bundle\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.818025 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.818001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f08024-2865-4637-859a-2fa127f291fa-console-oauth-config\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.818154 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.818137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f08024-2865-4637-859a-2fa127f291fa-console-serving-cert\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.824944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.824922 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdsc8\" (UniqueName: \"kubernetes.io/projected/14f08024-2865-4637-859a-2fa127f291fa-kube-api-access-sdsc8\") pod \"console-7bb5ff4c98-9nktv\" (UID: \"14f08024-2865-4637-859a-2fa127f291fa\") " pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:27.930910 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:27.930825 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:28.056799 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:28.056775 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb5ff4c98-9nktv"] Jun 02 15:29:28.058912 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:29:28.058876 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f08024_2865_4637_859a_2fa127f291fa.slice/crio-eb95b13e11779321d041f1a73cb5b0ebd55542d89664ae02fe4392e08448c284 WatchSource:0}: Error finding container eb95b13e11779321d041f1a73cb5b0ebd55542d89664ae02fe4392e08448c284: Status 404 returned error can't find the container with id eb95b13e11779321d041f1a73cb5b0ebd55542d89664ae02fe4392e08448c284 Jun 02 15:29:28.060687 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:28.060667 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:29:29.064598 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:29.064552 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb5ff4c98-9nktv" event={"ID":"14f08024-2865-4637-859a-2fa127f291fa","Type":"ContainerStarted","Data":"1f7b9d3909420aa048c0714f22f24612710fcc4e0bf674bcc22f85dfbebdeb9f"} Jun 02 15:29:29.064598 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:29.064601 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb5ff4c98-9nktv" event={"ID":"14f08024-2865-4637-859a-2fa127f291fa","Type":"ContainerStarted","Data":"eb95b13e11779321d041f1a73cb5b0ebd55542d89664ae02fe4392e08448c284"} Jun 02 15:29:37.930989 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:37.930946 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:37.931361 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:37.931005 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:37.935641 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:37.935619 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:37.961682 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:37.961640 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bb5ff4c98-9nktv" podStartSLOduration=10.961627879 podStartE2EDuration="10.961627879s" podCreationTimestamp="2026-06-02 15:29:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:29:29.126530531 +0000 UTC m=+335.732223224" watchObservedRunningTime="2026-06-02 15:29:37.961627879 +0000 UTC m=+344.567320572" Jun 02 15:29:38.095864 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:38.095839 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb5ff4c98-9nktv" Jun 02 15:29:38.154096 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:38.154066 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d876cc5-52qq2"] Jun 02 15:29:54.270194 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.270120 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s7x2k"] Jun 02 15:29:54.273607 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.273591 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.278043 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.278023 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:29:54.283967 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.283939 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s7x2k"] Jun 02 15:29:54.435740 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.435712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a91aa4f2-5920-44dd-bf1e-208254b734b4-kubelet-config\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.435905 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.435780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a91aa4f2-5920-44dd-bf1e-208254b734b4-dbus\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.435905 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.435845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a91aa4f2-5920-44dd-bf1e-208254b734b4-original-pull-secret\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.537244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.537159 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a91aa4f2-5920-44dd-bf1e-208254b734b4-dbus\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.537244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.537208 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a91aa4f2-5920-44dd-bf1e-208254b734b4-original-pull-secret\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.537409 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.537323 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a91aa4f2-5920-44dd-bf1e-208254b734b4-kubelet-config\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.537409 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.537340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a91aa4f2-5920-44dd-bf1e-208254b734b4-dbus\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.537484 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.537413 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a91aa4f2-5920-44dd-bf1e-208254b734b4-kubelet-config\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.539506 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.539490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a91aa4f2-5920-44dd-bf1e-208254b734b4-original-pull-secret\") pod \"global-pull-secret-syncer-s7x2k\" (UID: \"a91aa4f2-5920-44dd-bf1e-208254b734b4\") " pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.582640 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.582617 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7x2k" Jun 02 15:29:54.706074 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:54.706042 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s7x2k"] Jun 02 15:29:54.708844 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:29:54.708816 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91aa4f2_5920_44dd_bf1e_208254b734b4.slice/crio-8d5b8e017dd687131fc361041556f64c2d0b8888cc447b0e09ac629e1cbf54a3 WatchSource:0}: Error finding container 8d5b8e017dd687131fc361041556f64c2d0b8888cc447b0e09ac629e1cbf54a3: Status 404 returned error can't find the container with id 8d5b8e017dd687131fc361041556f64c2d0b8888cc447b0e09ac629e1cbf54a3 Jun 02 15:29:55.139787 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:55.139752 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s7x2k" event={"ID":"a91aa4f2-5920-44dd-bf1e-208254b734b4","Type":"ContainerStarted","Data":"8d5b8e017dd687131fc361041556f64c2d0b8888cc447b0e09ac629e1cbf54a3"} Jun 02 15:29:59.153686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:59.153654 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s7x2k" event={"ID":"a91aa4f2-5920-44dd-bf1e-208254b734b4","Type":"ContainerStarted","Data":"296574ff40beacc29479e8aeab8e9c95bd61762be3d053f927e7c9b13e080f41"} Jun 02 15:29:59.171740 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:29:59.171694 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s7x2k" podStartSLOduration=1.1464636129999999 podStartE2EDuration="5.17168078s" podCreationTimestamp="2026-06-02 15:29:54 +0000 UTC" firstStartedPulling="2026-06-02 15:29:54.7104874 +0000 UTC m=+361.316180075" lastFinishedPulling="2026-06-02 15:29:58.735704558 +0000 UTC m=+365.341397242" observedRunningTime="2026-06-02 15:29:59.171152096 +0000 UTC m=+365.776844800" watchObservedRunningTime="2026-06-02 15:29:59.17168078 +0000 UTC m=+365.777373475" Jun 02 15:30:03.175208 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.175151 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76d876cc5-52qq2" podUID="4120b93e-70c7-4a43-8586-d1d276fba779" containerName="console" containerID="cri-o://1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b" gracePeriod=15 Jun 02 15:30:03.407150 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.407129 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76d876cc5-52qq2_4120b93e-70c7-4a43-8586-d1d276fba779/console/0.log" Jun 02 15:30:03.407247 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.407189 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:30:03.511107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511039 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-trusted-ca-bundle\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511076 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-oauth-config\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511293 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511127 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-oauth-serving-cert\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511293 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511162 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-console-config\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511293 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511177 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-service-ca\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511293 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511201 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cllkz\" (UniqueName: \"kubernetes.io/projected/4120b93e-70c7-4a43-8586-d1d276fba779-kube-api-access-cllkz\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511293 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511250 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-serving-cert\") pod \"4120b93e-70c7-4a43-8586-d1d276fba779\" (UID: \"4120b93e-70c7-4a43-8586-d1d276fba779\") " Jun 02 15:30:03.511565 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511484 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:30:03.511708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511538 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:30:03.511708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511595 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-service-ca" (OuterVolumeSpecName: "service-ca") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:30:03.511708 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.511607 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-console-config" (OuterVolumeSpecName: "console-config") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:30:03.513452 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.513428 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:30:03.513563 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.513531 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4120b93e-70c7-4a43-8586-d1d276fba779-kube-api-access-cllkz" (OuterVolumeSpecName: "kube-api-access-cllkz") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "kube-api-access-cllkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:30:03.513688 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.513624 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4120b93e-70c7-4a43-8586-d1d276fba779" (UID: "4120b93e-70c7-4a43-8586-d1d276fba779"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:30:03.612357 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612327 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-console-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:03.612357 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612355 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-service-ca\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:03.612518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612364 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cllkz\" (UniqueName: \"kubernetes.io/projected/4120b93e-70c7-4a43-8586-d1d276fba779-kube-api-access-cllkz\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:03.612518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612374 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-serving-cert\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:03.612518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612382 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-trusted-ca-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:03.612518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612390 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4120b93e-70c7-4a43-8586-d1d276fba779-console-oauth-config\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:03.612518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:03.612398 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4120b93e-70c7-4a43-8586-d1d276fba779-oauth-serving-cert\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:30:04.168356 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.168329 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76d876cc5-52qq2_4120b93e-70c7-4a43-8586-d1d276fba779/console/0.log" Jun 02 15:30:04.168488 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.168366 2579 generic.go:358] "Generic (PLEG): container finished" podID="4120b93e-70c7-4a43-8586-d1d276fba779" containerID="1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b" exitCode=2 Jun 02 15:30:04.168488 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.168426 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d876cc5-52qq2" Jun 02 15:30:04.168488 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.168462 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d876cc5-52qq2" event={"ID":"4120b93e-70c7-4a43-8586-d1d276fba779","Type":"ContainerDied","Data":"1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b"} Jun 02 15:30:04.168640 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.168496 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d876cc5-52qq2" event={"ID":"4120b93e-70c7-4a43-8586-d1d276fba779","Type":"ContainerDied","Data":"a678d52234c50579bdf8730e3e50bdcbd385bcff6442c9450d7ed741ff0a616a"} Jun 02 15:30:04.168640 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.168511 2579 scope.go:117] "RemoveContainer" containerID="1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b" Jun 02 15:30:04.176344 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.176161 2579 scope.go:117] "RemoveContainer" containerID="1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b" Jun 02 15:30:04.176566 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:30:04.176430 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b\": container with ID starting with 1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b not found: ID does not exist" containerID="1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b" Jun 02 15:30:04.176566 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.176452 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b"} err="failed to get container status \"1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b\": rpc error: code = NotFound desc = could not find container \"1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b\": container with ID starting with 1ce6b4e33461437d2d6296cf3af5d3828fa04d359005a8816547081953cd291b not found: ID does not exist" Jun 02 15:30:04.189155 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.189131 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d876cc5-52qq2"] Jun 02 15:30:04.193215 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:04.193193 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76d876cc5-52qq2"] Jun 02 15:30:06.032613 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:30:06.032553 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4120b93e-70c7-4a43-8586-d1d276fba779" path="/var/lib/kubelet/pods/4120b93e-70c7-4a43-8586-d1d276fba779/volumes" Jun 02 15:32:08.223946 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.223911 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br"] Jun 02 15:32:08.224386 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.224216 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4120b93e-70c7-4a43-8586-d1d276fba779" containerName="console" Jun 02 15:32:08.224386 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.224228 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4120b93e-70c7-4a43-8586-d1d276fba779" containerName="console" Jun 02 15:32:08.224386 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.224296 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="4120b93e-70c7-4a43-8586-d1d276fba779" containerName="console" Jun 02 15:32:08.226407 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.226387 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.229381 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.229360 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 15:32:08.230142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.230120 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 15:32:08.230496 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.230480 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tfcnr\"" Jun 02 15:32:08.250262 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.250241 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br"] Jun 02 15:32:08.377918 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.377871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.378101 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.377945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.378101 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.377995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bvzc\" (UniqueName: \"kubernetes.io/projected/c916dbbb-8888-471d-88d1-d78e4566926f-kube-api-access-5bvzc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.478816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.478728 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bvzc\" (UniqueName: \"kubernetes.io/projected/c916dbbb-8888-471d-88d1-d78e4566926f-kube-api-access-5bvzc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.478816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.478782 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.479004 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.478827 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.479166 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.479151 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.479204 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.479185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.487856 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.487823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bvzc\" (UniqueName: \"kubernetes.io/projected/c916dbbb-8888-471d-88d1-d78e4566926f-kube-api-access-5bvzc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.535899 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.535864 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:08.665031 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:08.664998 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br"] Jun 02 15:32:08.669063 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:32:08.669036 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc916dbbb_8888_471d_88d1_d78e4566926f.slice/crio-2207feabc21a43c2cf3a2e78e9bcbd311c2b0b5e7a7b89e13fcf876a84572bcc WatchSource:0}: Error finding container 2207feabc21a43c2cf3a2e78e9bcbd311c2b0b5e7a7b89e13fcf876a84572bcc: Status 404 returned error can't find the container with id 2207feabc21a43c2cf3a2e78e9bcbd311c2b0b5e7a7b89e13fcf876a84572bcc Jun 02 15:32:09.553402 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:09.553368 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" event={"ID":"c916dbbb-8888-471d-88d1-d78e4566926f","Type":"ContainerStarted","Data":"2207feabc21a43c2cf3a2e78e9bcbd311c2b0b5e7a7b89e13fcf876a84572bcc"} Jun 02 15:32:16.580093 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:16.580060 2579 generic.go:358] "Generic (PLEG): container finished" podID="c916dbbb-8888-471d-88d1-d78e4566926f" containerID="96901ec9b609aa0128ab9e6e79dd47c2206ef6ffb8f57106da7beee0d065c157" exitCode=0 Jun 02 15:32:16.580467 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:16.580144 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" event={"ID":"c916dbbb-8888-471d-88d1-d78e4566926f","Type":"ContainerDied","Data":"96901ec9b609aa0128ab9e6e79dd47c2206ef6ffb8f57106da7beee0d065c157"} Jun 02 15:32:20.598992 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:20.598958 2579 generic.go:358] "Generic (PLEG): container finished" podID="c916dbbb-8888-471d-88d1-d78e4566926f" containerID="f72cabcb940cba14e0fa84a982fad437783a8733e040a4621f598d6de87e197d" exitCode=0 Jun 02 15:32:20.599377 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:20.599048 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" event={"ID":"c916dbbb-8888-471d-88d1-d78e4566926f","Type":"ContainerDied","Data":"f72cabcb940cba14e0fa84a982fad437783a8733e040a4621f598d6de87e197d"} Jun 02 15:32:30.631647 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:30.631620 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" event={"ID":"c916dbbb-8888-471d-88d1-d78e4566926f","Type":"ContainerStarted","Data":"8192ee6969fa7107ba3c8f96caaca9360a0a7dcaf227041f4d6eb509ee036c22"} Jun 02 15:32:30.652362 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:30.652319 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" podStartSLOduration=0.906884841 podStartE2EDuration="22.652305967s" podCreationTimestamp="2026-06-02 15:32:08 +0000 UTC" firstStartedPulling="2026-06-02 15:32:08.670808215 +0000 UTC m=+495.276500887" lastFinishedPulling="2026-06-02 15:32:30.416229341 +0000 UTC m=+517.021922013" observedRunningTime="2026-06-02 15:32:30.64971713 +0000 UTC m=+517.255409825" watchObservedRunningTime="2026-06-02 15:32:30.652305967 +0000 UTC m=+517.257998661" Jun 02 15:32:31.638548 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:31.638513 2579 generic.go:358] "Generic (PLEG): container finished" podID="c916dbbb-8888-471d-88d1-d78e4566926f" containerID="8192ee6969fa7107ba3c8f96caaca9360a0a7dcaf227041f4d6eb509ee036c22" exitCode=0 Jun 02 15:32:31.638936 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:31.638582 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" event={"ID":"c916dbbb-8888-471d-88d1-d78e4566926f","Type":"ContainerDied","Data":"8192ee6969fa7107ba3c8f96caaca9360a0a7dcaf227041f4d6eb509ee036c22"} Jun 02 15:32:32.768072 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.768049 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:32.788016 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.787990 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-bundle\") pod \"c916dbbb-8888-471d-88d1-d78e4566926f\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " Jun 02 15:32:32.788141 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.788087 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-util\") pod \"c916dbbb-8888-471d-88d1-d78e4566926f\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " Jun 02 15:32:32.788141 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.788124 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bvzc\" (UniqueName: \"kubernetes.io/projected/c916dbbb-8888-471d-88d1-d78e4566926f-kube-api-access-5bvzc\") pod \"c916dbbb-8888-471d-88d1-d78e4566926f\" (UID: \"c916dbbb-8888-471d-88d1-d78e4566926f\") " Jun 02 15:32:32.788898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.788868 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-bundle" (OuterVolumeSpecName: "bundle") pod "c916dbbb-8888-471d-88d1-d78e4566926f" (UID: "c916dbbb-8888-471d-88d1-d78e4566926f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:32:32.791257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.791230 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c916dbbb-8888-471d-88d1-d78e4566926f-kube-api-access-5bvzc" (OuterVolumeSpecName: "kube-api-access-5bvzc") pod "c916dbbb-8888-471d-88d1-d78e4566926f" (UID: "c916dbbb-8888-471d-88d1-d78e4566926f"). InnerVolumeSpecName "kube-api-access-5bvzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:32:32.793406 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.793378 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-util" (OuterVolumeSpecName: "util") pod "c916dbbb-8888-471d-88d1-d78e4566926f" (UID: "c916dbbb-8888-471d-88d1-d78e4566926f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:32:32.889555 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.889526 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:32:32.889555 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.889553 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c916dbbb-8888-471d-88d1-d78e4566926f-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:32:32.889749 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:32.889566 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bvzc\" (UniqueName: \"kubernetes.io/projected/c916dbbb-8888-471d-88d1-d78e4566926f-kube-api-access-5bvzc\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:32:33.645746 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:33.645719 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" Jun 02 15:32:33.645903 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:33.645718 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d286br" event={"ID":"c916dbbb-8888-471d-88d1-d78e4566926f","Type":"ContainerDied","Data":"2207feabc21a43c2cf3a2e78e9bcbd311c2b0b5e7a7b89e13fcf876a84572bcc"} Jun 02 15:32:33.645903 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:33.645822 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2207feabc21a43c2cf3a2e78e9bcbd311c2b0b5e7a7b89e13fcf876a84572bcc" Jun 02 15:32:41.513879 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.513798 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2"] Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514128 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="util" Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514139 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="util" Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514156 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="extract" Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514161 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="extract" Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514171 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="pull" Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514176 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="pull" Jun 02 15:32:41.514322 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.514226 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="c916dbbb-8888-471d-88d1-d78e4566926f" containerName="extract" Jun 02 15:32:41.517001 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.516986 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.519988 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.519959 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gz9l4\"" Jun 02 15:32:41.519988 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.519983 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 15:32:41.520162 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.519967 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:32:41.530411 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.530385 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2"] Jun 02 15:32:41.560428 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.560397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7tp\" (UniqueName: \"kubernetes.io/projected/e65cf258-654d-4fd2-a49b-339f5cea99f6-kube-api-access-zd7tp\") pod \"cert-manager-operator-controller-manager-54b9655956-jfcr2\" (UID: \"e65cf258-654d-4fd2-a49b-339f5cea99f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.560428 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.560439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e65cf258-654d-4fd2-a49b-339f5cea99f6-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jfcr2\" (UID: \"e65cf258-654d-4fd2-a49b-339f5cea99f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.661378 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.661342 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7tp\" (UniqueName: \"kubernetes.io/projected/e65cf258-654d-4fd2-a49b-339f5cea99f6-kube-api-access-zd7tp\") pod \"cert-manager-operator-controller-manager-54b9655956-jfcr2\" (UID: \"e65cf258-654d-4fd2-a49b-339f5cea99f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.661529 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.661386 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e65cf258-654d-4fd2-a49b-339f5cea99f6-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jfcr2\" (UID: \"e65cf258-654d-4fd2-a49b-339f5cea99f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.661738 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.661722 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e65cf258-654d-4fd2-a49b-339f5cea99f6-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jfcr2\" (UID: \"e65cf258-654d-4fd2-a49b-339f5cea99f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.675241 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.675203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7tp\" (UniqueName: \"kubernetes.io/projected/e65cf258-654d-4fd2-a49b-339f5cea99f6-kube-api-access-zd7tp\") pod \"cert-manager-operator-controller-manager-54b9655956-jfcr2\" (UID: \"e65cf258-654d-4fd2-a49b-339f5cea99f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.825557 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.825472 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" Jun 02 15:32:41.961839 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:41.961814 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2"] Jun 02 15:32:41.964200 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:32:41.964172 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65cf258_654d_4fd2_a49b_339f5cea99f6.slice/crio-a3e010b8440951e425ffd0e7459bdb3f0ebb1e3fff6ebc8efc3b53f36469c16e WatchSource:0}: Error finding container a3e010b8440951e425ffd0e7459bdb3f0ebb1e3fff6ebc8efc3b53f36469c16e: Status 404 returned error can't find the container with id a3e010b8440951e425ffd0e7459bdb3f0ebb1e3fff6ebc8efc3b53f36469c16e Jun 02 15:32:42.673940 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:42.673904 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" event={"ID":"e65cf258-654d-4fd2-a49b-339f5cea99f6","Type":"ContainerStarted","Data":"a3e010b8440951e425ffd0e7459bdb3f0ebb1e3fff6ebc8efc3b53f36469c16e"} Jun 02 15:32:44.682350 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:44.682315 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" event={"ID":"e65cf258-654d-4fd2-a49b-339f5cea99f6","Type":"ContainerStarted","Data":"4bf9efe5f6009218f4ba2f174d5f9f6891908f02cec69c0d8aaa28b281cf7470"} Jun 02 15:32:44.729876 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:44.729812 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jfcr2" podStartSLOduration=1.706056968 podStartE2EDuration="3.729791654s" podCreationTimestamp="2026-06-02 15:32:41 +0000 UTC" firstStartedPulling="2026-06-02 15:32:41.966700516 +0000 UTC m=+528.572393190" lastFinishedPulling="2026-06-02 15:32:43.990435205 +0000 UTC m=+530.596127876" observedRunningTime="2026-06-02 15:32:44.727902882 +0000 UTC m=+531.333595575" watchObservedRunningTime="2026-06-02 15:32:44.729791654 +0000 UTC m=+531.335484350" Jun 02 15:32:45.842335 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.842303 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7"] Jun 02 15:32:45.847300 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.847267 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:45.850430 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.850404 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 15:32:45.851396 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.851377 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 15:32:45.851474 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.851395 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tfcnr\"" Jun 02 15:32:45.855787 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.855759 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7"] Jun 02 15:32:45.899309 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.899277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppm7x\" (UniqueName: \"kubernetes.io/projected/9a282aac-863f-4bf9-9d7f-1a6478f61977-kube-api-access-ppm7x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:45.899458 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.899322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:45.899458 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:45.899394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.000616 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.000558 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.000778 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.000668 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppm7x\" (UniqueName: \"kubernetes.io/projected/9a282aac-863f-4bf9-9d7f-1a6478f61977-kube-api-access-ppm7x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.000778 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.000713 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.001041 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.001018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.001094 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.001080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.010827 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.010797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppm7x\" (UniqueName: \"kubernetes.io/projected/9a282aac-863f-4bf9-9d7f-1a6478f61977-kube-api-access-ppm7x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.157944 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.157857 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:46.272430 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.272402 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-7qg7p"] Jun 02 15:32:46.276972 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.276953 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.279961 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.279933 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5kdsx\"" Jun 02 15:32:46.280090 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.280072 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 15:32:46.280142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.280118 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 15:32:46.287803 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.287784 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-7qg7p"] Jun 02 15:32:46.291115 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.291094 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7"] Jun 02 15:32:46.292901 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:32:46.292871 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a282aac_863f_4bf9_9d7f_1a6478f61977.slice/crio-ef5fa3a0e5f012dbe79b9af38004e42a17cfe467a6922219568163344adf4452 WatchSource:0}: Error finding container ef5fa3a0e5f012dbe79b9af38004e42a17cfe467a6922219568163344adf4452: Status 404 returned error can't find the container with id ef5fa3a0e5f012dbe79b9af38004e42a17cfe467a6922219568163344adf4452 Jun 02 15:32:46.404817 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.404790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t62xx\" (UniqueName: \"kubernetes.io/projected/fbf23108-c064-49ca-b677-74021f1cf586-kube-api-access-t62xx\") pod \"cert-manager-webhook-587ccfb98-7qg7p\" (UID: \"fbf23108-c064-49ca-b677-74021f1cf586\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.404922 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.404899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbf23108-c064-49ca-b677-74021f1cf586-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-7qg7p\" (UID: \"fbf23108-c064-49ca-b677-74021f1cf586\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.505422 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.505337 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t62xx\" (UniqueName: \"kubernetes.io/projected/fbf23108-c064-49ca-b677-74021f1cf586-kube-api-access-t62xx\") pod \"cert-manager-webhook-587ccfb98-7qg7p\" (UID: \"fbf23108-c064-49ca-b677-74021f1cf586\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.505422 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.505407 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbf23108-c064-49ca-b677-74021f1cf586-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-7qg7p\" (UID: \"fbf23108-c064-49ca-b677-74021f1cf586\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.516810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.516782 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbf23108-c064-49ca-b677-74021f1cf586-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-7qg7p\" (UID: \"fbf23108-c064-49ca-b677-74021f1cf586\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.517587 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.517554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t62xx\" (UniqueName: \"kubernetes.io/projected/fbf23108-c064-49ca-b677-74021f1cf586-kube-api-access-t62xx\") pod \"cert-manager-webhook-587ccfb98-7qg7p\" (UID: \"fbf23108-c064-49ca-b677-74021f1cf586\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.593696 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.593665 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:46.691427 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.691393 2579 generic.go:358] "Generic (PLEG): container finished" podID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerID="f43653f1cfb465ec43dbeeaf6136bf7125594a44b6805e290c1dca511be09d87" exitCode=0 Jun 02 15:32:46.691624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.691457 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" event={"ID":"9a282aac-863f-4bf9-9d7f-1a6478f61977","Type":"ContainerDied","Data":"f43653f1cfb465ec43dbeeaf6136bf7125594a44b6805e290c1dca511be09d87"} Jun 02 15:32:46.691624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.691478 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" event={"ID":"9a282aac-863f-4bf9-9d7f-1a6478f61977","Type":"ContainerStarted","Data":"ef5fa3a0e5f012dbe79b9af38004e42a17cfe467a6922219568163344adf4452"} Jun 02 15:32:46.726631 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:46.726526 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-7qg7p"] Jun 02 15:32:46.729251 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:32:46.729232 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbf23108_c064_49ca_b677_74021f1cf586.slice/crio-b2752ac2651972ded700c86ab4c8499ed5b64f65adaa6aba48f2bb689fd5f362 WatchSource:0}: Error finding container b2752ac2651972ded700c86ab4c8499ed5b64f65adaa6aba48f2bb689fd5f362: Status 404 returned error can't find the container with id b2752ac2651972ded700c86ab4c8499ed5b64f65adaa6aba48f2bb689fd5f362 Jun 02 15:32:47.696131 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:47.696094 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" event={"ID":"fbf23108-c064-49ca-b677-74021f1cf586","Type":"ContainerStarted","Data":"b2752ac2651972ded700c86ab4c8499ed5b64f65adaa6aba48f2bb689fd5f362"} Jun 02 15:32:48.389258 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.389208 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-8x8lb"] Jun 02 15:32:48.393219 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.393193 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.397518 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.397494 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6jh2x\"" Jun 02 15:32:48.404138 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.404096 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-8x8lb"] Jun 02 15:32:48.525816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.525779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd56f024-50ee-4033-a1df-aa24026e2724-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-8x8lb\" (UID: \"cd56f024-50ee-4033-a1df-aa24026e2724\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.526194 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.525883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swwr\" (UniqueName: \"kubernetes.io/projected/cd56f024-50ee-4033-a1df-aa24026e2724-kube-api-access-2swwr\") pod \"cert-manager-cainjector-68b757865b-8x8lb\" (UID: \"cd56f024-50ee-4033-a1df-aa24026e2724\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.626424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.626392 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2swwr\" (UniqueName: \"kubernetes.io/projected/cd56f024-50ee-4033-a1df-aa24026e2724-kube-api-access-2swwr\") pod \"cert-manager-cainjector-68b757865b-8x8lb\" (UID: \"cd56f024-50ee-4033-a1df-aa24026e2724\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.626614 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.626482 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd56f024-50ee-4033-a1df-aa24026e2724-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-8x8lb\" (UID: \"cd56f024-50ee-4033-a1df-aa24026e2724\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.635762 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.635735 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swwr\" (UniqueName: \"kubernetes.io/projected/cd56f024-50ee-4033-a1df-aa24026e2724-kube-api-access-2swwr\") pod \"cert-manager-cainjector-68b757865b-8x8lb\" (UID: \"cd56f024-50ee-4033-a1df-aa24026e2724\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.635889 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.635738 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd56f024-50ee-4033-a1df-aa24026e2724-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-8x8lb\" (UID: \"cd56f024-50ee-4033-a1df-aa24026e2724\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:48.705771 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:48.705697 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" Jun 02 15:32:50.021333 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.021250 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-8x8lb"] Jun 02 15:32:50.024373 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:32:50.024344 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd56f024_50ee_4033_a1df_aa24026e2724.slice/crio-b62cf654f2081cd74cabfe24a905169f62734c86d63a2f840828ac00dd1a167e WatchSource:0}: Error finding container b62cf654f2081cd74cabfe24a905169f62734c86d63a2f840828ac00dd1a167e: Status 404 returned error can't find the container with id b62cf654f2081cd74cabfe24a905169f62734c86d63a2f840828ac00dd1a167e Jun 02 15:32:50.708900 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.708863 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" event={"ID":"cd56f024-50ee-4033-a1df-aa24026e2724","Type":"ContainerStarted","Data":"4330d047ddd23f24fa8c6c8e188202f13a5831ff5475f35c63adeca6994fcf94"} Jun 02 15:32:50.709088 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.708912 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" event={"ID":"cd56f024-50ee-4033-a1df-aa24026e2724","Type":"ContainerStarted","Data":"b62cf654f2081cd74cabfe24a905169f62734c86d63a2f840828ac00dd1a167e"} Jun 02 15:32:50.710316 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.710291 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" event={"ID":"fbf23108-c064-49ca-b677-74021f1cf586","Type":"ContainerStarted","Data":"6a9e1a1c4c5d145df192938f03cf8964cfe137c1ef87553bae500d1a416f28d9"} Jun 02 15:32:50.710433 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.710348 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:50.711935 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.711908 2579 generic.go:358] "Generic (PLEG): container finished" podID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerID="f59b6d48312c476e31727a23215c282f2058c40d36aa0fea77097e3ea822aadf" exitCode=0 Jun 02 15:32:50.712028 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.711982 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" event={"ID":"9a282aac-863f-4bf9-9d7f-1a6478f61977","Type":"ContainerDied","Data":"f59b6d48312c476e31727a23215c282f2058c40d36aa0fea77097e3ea822aadf"} Jun 02 15:32:50.729006 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.728967 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-8x8lb" podStartSLOduration=2.728953832 podStartE2EDuration="2.728953832s" podCreationTimestamp="2026-06-02 15:32:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:32:50.727910792 +0000 UTC m=+537.333603486" watchObservedRunningTime="2026-06-02 15:32:50.728953832 +0000 UTC m=+537.334646527" Jun 02 15:32:50.747544 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:50.747493 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" podStartSLOduration=1.584088717 podStartE2EDuration="4.747475057s" podCreationTimestamp="2026-06-02 15:32:46 +0000 UTC" firstStartedPulling="2026-06-02 15:32:46.731024287 +0000 UTC m=+533.336716960" lastFinishedPulling="2026-06-02 15:32:49.894410615 +0000 UTC m=+536.500103300" observedRunningTime="2026-06-02 15:32:50.746092115 +0000 UTC m=+537.351784812" watchObservedRunningTime="2026-06-02 15:32:50.747475057 +0000 UTC m=+537.353167752" Jun 02 15:32:51.717174 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:51.717139 2579 generic.go:358] "Generic (PLEG): container finished" podID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerID="3a9837ced0e515ec9a6ce560cbd5c97b13d54992e7aced4bcbafe6902199b003" exitCode=0 Jun 02 15:32:51.717543 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:51.717232 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" event={"ID":"9a282aac-863f-4bf9-9d7f-1a6478f61977","Type":"ContainerDied","Data":"3a9837ced0e515ec9a6ce560cbd5c97b13d54992e7aced4bcbafe6902199b003"} Jun 02 15:32:52.855206 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.855184 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:52.966726 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.966686 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-bundle\") pod \"9a282aac-863f-4bf9-9d7f-1a6478f61977\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " Jun 02 15:32:52.966891 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.966807 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-util\") pod \"9a282aac-863f-4bf9-9d7f-1a6478f61977\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " Jun 02 15:32:52.966891 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.966836 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppm7x\" (UniqueName: \"kubernetes.io/projected/9a282aac-863f-4bf9-9d7f-1a6478f61977-kube-api-access-ppm7x\") pod \"9a282aac-863f-4bf9-9d7f-1a6478f61977\" (UID: \"9a282aac-863f-4bf9-9d7f-1a6478f61977\") " Jun 02 15:32:52.967145 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.967115 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-bundle" (OuterVolumeSpecName: "bundle") pod "9a282aac-863f-4bf9-9d7f-1a6478f61977" (UID: "9a282aac-863f-4bf9-9d7f-1a6478f61977"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:32:52.969115 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.969087 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a282aac-863f-4bf9-9d7f-1a6478f61977-kube-api-access-ppm7x" (OuterVolumeSpecName: "kube-api-access-ppm7x") pod "9a282aac-863f-4bf9-9d7f-1a6478f61977" (UID: "9a282aac-863f-4bf9-9d7f-1a6478f61977"). InnerVolumeSpecName "kube-api-access-ppm7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:32:52.973642 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:52.973551 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-util" (OuterVolumeSpecName: "util") pod "9a282aac-863f-4bf9-9d7f-1a6478f61977" (UID: "9a282aac-863f-4bf9-9d7f-1a6478f61977"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:32:53.067785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:53.067752 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:32:53.067785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:53.067781 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppm7x\" (UniqueName: \"kubernetes.io/projected/9a282aac-863f-4bf9-9d7f-1a6478f61977-kube-api-access-ppm7x\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:32:53.067957 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:53.067793 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a282aac-863f-4bf9-9d7f-1a6478f61977-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:32:53.725167 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:53.725133 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" Jun 02 15:32:53.725167 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:53.725150 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8km7" event={"ID":"9a282aac-863f-4bf9-9d7f-1a6478f61977","Type":"ContainerDied","Data":"ef5fa3a0e5f012dbe79b9af38004e42a17cfe467a6922219568163344adf4452"} Jun 02 15:32:53.725362 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:53.725182 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef5fa3a0e5f012dbe79b9af38004e42a17cfe467a6922219568163344adf4452" Jun 02 15:32:56.719556 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:56.719518 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-7qg7p" Jun 02 15:32:59.101025 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.100985 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j"] Jun 02 15:32:59.101470 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101391 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="util" Jun 02 15:32:59.101470 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101404 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="util" Jun 02 15:32:59.101470 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101416 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="pull" Jun 02 15:32:59.101470 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101421 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="pull" Jun 02 15:32:59.101470 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101431 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="extract" Jun 02 15:32:59.101470 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101437 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="extract" Jun 02 15:32:59.101699 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.101498 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a282aac-863f-4bf9-9d7f-1a6478f61977" containerName="extract" Jun 02 15:32:59.155055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.155028 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j"] Jun 02 15:32:59.155202 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.155139 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.160527 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.160493 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 15:32:59.161014 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.160993 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vqgz6\"" Jun 02 15:32:59.161735 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.161714 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:32:59.322899 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.322868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/019eea57-6bc7-4e45-b702-5efb924fdb85-tmp\") pod \"openshift-lws-operator-bfc7f696d-lfj4j\" (UID: \"019eea57-6bc7-4e45-b702-5efb924fdb85\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.323083 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.322917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrq8\" (UniqueName: \"kubernetes.io/projected/019eea57-6bc7-4e45-b702-5efb924fdb85-kube-api-access-hhrq8\") pod \"openshift-lws-operator-bfc7f696d-lfj4j\" (UID: \"019eea57-6bc7-4e45-b702-5efb924fdb85\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.423967 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.423884 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/019eea57-6bc7-4e45-b702-5efb924fdb85-tmp\") pod \"openshift-lws-operator-bfc7f696d-lfj4j\" (UID: \"019eea57-6bc7-4e45-b702-5efb924fdb85\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.423967 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.423928 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrq8\" (UniqueName: \"kubernetes.io/projected/019eea57-6bc7-4e45-b702-5efb924fdb85-kube-api-access-hhrq8\") pod \"openshift-lws-operator-bfc7f696d-lfj4j\" (UID: \"019eea57-6bc7-4e45-b702-5efb924fdb85\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.424245 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.424227 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/019eea57-6bc7-4e45-b702-5efb924fdb85-tmp\") pod \"openshift-lws-operator-bfc7f696d-lfj4j\" (UID: \"019eea57-6bc7-4e45-b702-5efb924fdb85\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.434315 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.434293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrq8\" (UniqueName: \"kubernetes.io/projected/019eea57-6bc7-4e45-b702-5efb924fdb85-kube-api-access-hhrq8\") pod \"openshift-lws-operator-bfc7f696d-lfj4j\" (UID: \"019eea57-6bc7-4e45-b702-5efb924fdb85\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.464142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.464120 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" Jun 02 15:32:59.597023 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.596997 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j"] Jun 02 15:32:59.599549 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:32:59.599524 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod019eea57_6bc7_4e45_b702_5efb924fdb85.slice/crio-adf0ae4d9b9783cf5fb7db83b8ce1b97fbd0e91299f76b8f20bd912af8f3cc33 WatchSource:0}: Error finding container adf0ae4d9b9783cf5fb7db83b8ce1b97fbd0e91299f76b8f20bd912af8f3cc33: Status 404 returned error can't find the container with id adf0ae4d9b9783cf5fb7db83b8ce1b97fbd0e91299f76b8f20bd912af8f3cc33 Jun 02 15:32:59.745635 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:32:59.745551 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" event={"ID":"019eea57-6bc7-4e45-b702-5efb924fdb85","Type":"ContainerStarted","Data":"adf0ae4d9b9783cf5fb7db83b8ce1b97fbd0e91299f76b8f20bd912af8f3cc33"} Jun 02 15:33:03.760981 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:03.760939 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" event={"ID":"019eea57-6bc7-4e45-b702-5efb924fdb85","Type":"ContainerStarted","Data":"e418d910fdd2d88883abb6d6102656fbd84f644460fbabad5ec1dd5c9caa947b"} Jun 02 15:33:03.784237 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:03.784189 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lfj4j" podStartSLOduration=1.4372686940000001 podStartE2EDuration="4.7841753s" podCreationTimestamp="2026-06-02 15:32:59 +0000 UTC" firstStartedPulling="2026-06-02 15:32:59.601453995 +0000 UTC m=+546.207146668" lastFinishedPulling="2026-06-02 15:33:02.948360601 +0000 UTC m=+549.554053274" observedRunningTime="2026-06-02 15:33:03.782138154 +0000 UTC m=+550.387830848" watchObservedRunningTime="2026-06-02 15:33:03.7841753 +0000 UTC m=+550.389867994" Jun 02 15:33:06.532923 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.532884 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg"] Jun 02 15:33:06.535388 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.535367 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.539058 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.539032 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tfcnr\"" Jun 02 15:33:06.539198 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.539181 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 15:33:06.539274 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.539184 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 15:33:06.550426 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.550406 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg"] Jun 02 15:33:06.685078 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.685035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.685257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.685091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blcwp\" (UniqueName: \"kubernetes.io/projected/e9cd582b-9e4e-4e55-badc-50800696c608-kube-api-access-blcwp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.685257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.685160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.786158 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.786080 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.786158 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.786119 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blcwp\" (UniqueName: \"kubernetes.io/projected/e9cd582b-9e4e-4e55-badc-50800696c608-kube-api-access-blcwp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.786158 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.786146 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.786553 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.786536 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.786651 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.786537 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.802002 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.801973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blcwp\" (UniqueName: \"kubernetes.io/projected/e9cd582b-9e4e-4e55-badc-50800696c608-kube-api-access-blcwp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.845039 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.845015 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:06.979321 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:06.979292 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg"] Jun 02 15:33:06.981622 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:33:06.981600 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cd582b_9e4e_4e55_badc_50800696c608.slice/crio-c3fb7ca689d836e678af0fe40c49d2d054fb6fc123637b6f8182c9f4399f562d WatchSource:0}: Error finding container c3fb7ca689d836e678af0fe40c49d2d054fb6fc123637b6f8182c9f4399f562d: Status 404 returned error can't find the container with id c3fb7ca689d836e678af0fe40c49d2d054fb6fc123637b6f8182c9f4399f562d Jun 02 15:33:07.778094 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:07.778059 2579 generic.go:358] "Generic (PLEG): container finished" podID="e9cd582b-9e4e-4e55-badc-50800696c608" containerID="731470f508192cbe9986bd906006af037a2db930bd1f796ea1c510377049abf8" exitCode=0 Jun 02 15:33:07.778471 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:07.778136 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" event={"ID":"e9cd582b-9e4e-4e55-badc-50800696c608","Type":"ContainerDied","Data":"731470f508192cbe9986bd906006af037a2db930bd1f796ea1c510377049abf8"} Jun 02 15:33:07.778471 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:07.778159 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" event={"ID":"e9cd582b-9e4e-4e55-badc-50800696c608","Type":"ContainerStarted","Data":"c3fb7ca689d836e678af0fe40c49d2d054fb6fc123637b6f8182c9f4399f562d"} Jun 02 15:33:08.783269 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:08.783178 2579 generic.go:358] "Generic (PLEG): container finished" podID="e9cd582b-9e4e-4e55-badc-50800696c608" containerID="1fb417b86905c126743f46c1e88fe54cf28b1a6490aadd91e18e93cccaf4680c" exitCode=0 Jun 02 15:33:08.783269 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:08.783222 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" event={"ID":"e9cd582b-9e4e-4e55-badc-50800696c608","Type":"ContainerDied","Data":"1fb417b86905c126743f46c1e88fe54cf28b1a6490aadd91e18e93cccaf4680c"} Jun 02 15:33:09.788585 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:09.788549 2579 generic.go:358] "Generic (PLEG): container finished" podID="e9cd582b-9e4e-4e55-badc-50800696c608" containerID="109cee511e63e6e1d89efc95abd0382244fe25ef212a969acc70dcc1b3d50433" exitCode=0 Jun 02 15:33:09.788940 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:09.788622 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" event={"ID":"e9cd582b-9e4e-4e55-badc-50800696c608","Type":"ContainerDied","Data":"109cee511e63e6e1d89efc95abd0382244fe25ef212a969acc70dcc1b3d50433"} Jun 02 15:33:10.919760 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:10.919735 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:11.021996 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.021966 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-util\") pod \"e9cd582b-9e4e-4e55-badc-50800696c608\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " Jun 02 15:33:11.022142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.022017 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blcwp\" (UniqueName: \"kubernetes.io/projected/e9cd582b-9e4e-4e55-badc-50800696c608-kube-api-access-blcwp\") pod \"e9cd582b-9e4e-4e55-badc-50800696c608\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " Jun 02 15:33:11.022142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.022084 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-bundle\") pod \"e9cd582b-9e4e-4e55-badc-50800696c608\" (UID: \"e9cd582b-9e4e-4e55-badc-50800696c608\") " Jun 02 15:33:11.022810 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.022783 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-bundle" (OuterVolumeSpecName: "bundle") pod "e9cd582b-9e4e-4e55-badc-50800696c608" (UID: "e9cd582b-9e4e-4e55-badc-50800696c608"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:33:11.024201 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.024174 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9cd582b-9e4e-4e55-badc-50800696c608-kube-api-access-blcwp" (OuterVolumeSpecName: "kube-api-access-blcwp") pod "e9cd582b-9e4e-4e55-badc-50800696c608" (UID: "e9cd582b-9e4e-4e55-badc-50800696c608"). InnerVolumeSpecName "kube-api-access-blcwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:33:11.027284 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.027261 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-util" (OuterVolumeSpecName: "util") pod "e9cd582b-9e4e-4e55-badc-50800696c608" (UID: "e9cd582b-9e4e-4e55-badc-50800696c608"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:33:11.123187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.123154 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:33:11.123187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.123185 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blcwp\" (UniqueName: \"kubernetes.io/projected/e9cd582b-9e4e-4e55-badc-50800696c608-kube-api-access-blcwp\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:33:11.123400 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.123201 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9cd582b-9e4e-4e55-badc-50800696c608-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:33:11.797977 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.797947 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" Jun 02 15:33:11.797977 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.797964 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbxbwg" event={"ID":"e9cd582b-9e4e-4e55-badc-50800696c608","Type":"ContainerDied","Data":"c3fb7ca689d836e678af0fe40c49d2d054fb6fc123637b6f8182c9f4399f562d"} Jun 02 15:33:11.798248 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:11.797995 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3fb7ca689d836e678af0fe40c49d2d054fb6fc123637b6f8182c9f4399f562d" Jun 02 15:33:19.906878 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.906809 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99"] Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907287 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="util" Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907306 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="util" Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907330 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="pull" Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907338 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="pull" Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907354 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="extract" Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907363 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="extract" Jun 02 15:33:19.907453 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.907445 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9cd582b-9e4e-4e55-badc-50800696c608" containerName="extract" Jun 02 15:33:19.911834 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.911810 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:19.916331 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.916304 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 15:33:19.916484 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.916465 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 15:33:19.916565 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.916468 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wtvxv\"" Jun 02 15:33:19.916740 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.916727 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 15:33:19.918555 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.918227 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 15:33:19.949882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.949858 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99"] Jun 02 15:33:19.991278 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.991247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd120c42-6313-4216-adb6-c9a1c0c97dfd-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:19.991278 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.991277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd120c42-6313-4216-adb6-c9a1c0c97dfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:19.991497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.991298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwm8m\" (UniqueName: \"kubernetes.io/projected/cd120c42-6313-4216-adb6-c9a1c0c97dfd-kube-api-access-nwm8m\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:19.991497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.991325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd120c42-6313-4216-adb6-c9a1c0c97dfd-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:19.991497 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:19.991412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd120c42-6313-4216-adb6-c9a1c0c97dfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.092251 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.092217 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd120c42-6313-4216-adb6-c9a1c0c97dfd-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.092251 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.092251 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd120c42-6313-4216-adb6-c9a1c0c97dfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.092479 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.092271 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwm8m\" (UniqueName: \"kubernetes.io/projected/cd120c42-6313-4216-adb6-c9a1c0c97dfd-kube-api-access-nwm8m\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.092479 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.092401 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd120c42-6313-4216-adb6-c9a1c0c97dfd-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.092620 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.092516 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd120c42-6313-4216-adb6-c9a1c0c97dfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.092801 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.092777 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd120c42-6313-4216-adb6-c9a1c0c97dfd-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.095136 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.095106 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd120c42-6313-4216-adb6-c9a1c0c97dfd-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.095291 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.095266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd120c42-6313-4216-adb6-c9a1c0c97dfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.100870 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.100843 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd120c42-6313-4216-adb6-c9a1c0c97dfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.109017 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.108994 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwm8m\" (UniqueName: \"kubernetes.io/projected/cd120c42-6313-4216-adb6-c9a1c0c97dfd-kube-api-access-nwm8m\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99\" (UID: \"cd120c42-6313-4216-adb6-c9a1c0c97dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.222520 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.222447 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:20.402158 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.402086 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99"] Jun 02 15:33:20.404543 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:33:20.404513 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd120c42_6313_4216_adb6_c9a1c0c97dfd.slice/crio-b48d8737b877e89461911eaf23a917cdc5910db0d478b1b3e96055dc1bfb31a1 WatchSource:0}: Error finding container b48d8737b877e89461911eaf23a917cdc5910db0d478b1b3e96055dc1bfb31a1: Status 404 returned error can't find the container with id b48d8737b877e89461911eaf23a917cdc5910db0d478b1b3e96055dc1bfb31a1 Jun 02 15:33:20.830287 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:20.830248 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" event={"ID":"cd120c42-6313-4216-adb6-c9a1c0c97dfd","Type":"ContainerStarted","Data":"b48d8737b877e89461911eaf23a917cdc5910db0d478b1b3e96055dc1bfb31a1"} Jun 02 15:33:23.842533 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:23.842499 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" event={"ID":"cd120c42-6313-4216-adb6-c9a1c0c97dfd","Type":"ContainerStarted","Data":"4dd431281a69310f771fb8d41368da726af0aa86586f9ccd71c42e2280605bd3"} Jun 02 15:33:24.847662 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:24.847626 2579 generic.go:358] "Generic (PLEG): container finished" podID="cd120c42-6313-4216-adb6-c9a1c0c97dfd" containerID="4dd431281a69310f771fb8d41368da726af0aa86586f9ccd71c42e2280605bd3" exitCode=0 Jun 02 15:33:24.848071 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:24.847719 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" event={"ID":"cd120c42-6313-4216-adb6-c9a1c0c97dfd","Type":"ContainerDied","Data":"4dd431281a69310f771fb8d41368da726af0aa86586f9ccd71c42e2280605bd3"} Jun 02 15:33:25.853820 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:25.853788 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" event={"ID":"cd120c42-6313-4216-adb6-c9a1c0c97dfd","Type":"ContainerStarted","Data":"66180884ca34653a99300a0be59d60056d5e65e66f3229c47a0ad5480a5386cf"} Jun 02 15:33:25.854282 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:25.853930 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:25.903420 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:25.903351 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" podStartSLOduration=2.164790749 podStartE2EDuration="6.903332082s" podCreationTimestamp="2026-06-02 15:33:19 +0000 UTC" firstStartedPulling="2026-06-02 15:33:20.406324991 +0000 UTC m=+567.012017663" lastFinishedPulling="2026-06-02 15:33:25.144866321 +0000 UTC m=+571.750558996" observedRunningTime="2026-06-02 15:33:25.901241996 +0000 UTC m=+572.506934691" watchObservedRunningTime="2026-06-02 15:33:25.903332082 +0000 UTC m=+572.509024778" Jun 02 15:33:36.860242 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:36.860209 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99" Jun 02 15:33:39.726654 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.726613 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9"] Jun 02 15:33:39.735388 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.735360 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.745347 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.745327 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 15:33:39.748610 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.748590 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 15:33:39.748965 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.748950 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 15:33:39.749143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.749127 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q4xfk\"" Jun 02 15:33:39.777745 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.777718 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9"] Jun 02 15:33:39.871339 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.871311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5178d3db-9114-4856-bbf6-98f7017f75c1-cert\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.871505 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.871346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5178d3db-9114-4856-bbf6-98f7017f75c1-metrics-cert\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.871505 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.871386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfn5\" (UniqueName: \"kubernetes.io/projected/5178d3db-9114-4856-bbf6-98f7017f75c1-kube-api-access-nbfn5\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.871603 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.871502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5178d3db-9114-4856-bbf6-98f7017f75c1-manager-config\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.972854 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.972817 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5178d3db-9114-4856-bbf6-98f7017f75c1-cert\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.972854 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.972873 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5178d3db-9114-4856-bbf6-98f7017f75c1-metrics-cert\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.973125 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.972911 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfn5\" (UniqueName: \"kubernetes.io/projected/5178d3db-9114-4856-bbf6-98f7017f75c1-kube-api-access-nbfn5\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.973125 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.972936 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5178d3db-9114-4856-bbf6-98f7017f75c1-manager-config\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.973694 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.973670 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5178d3db-9114-4856-bbf6-98f7017f75c1-manager-config\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.975622 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.975596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5178d3db-9114-4856-bbf6-98f7017f75c1-metrics-cert\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.975920 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.975901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5178d3db-9114-4856-bbf6-98f7017f75c1-cert\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.990369 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.990314 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk"] Jun 02 15:33:39.991326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.991305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfn5\" (UniqueName: \"kubernetes.io/projected/5178d3db-9114-4856-bbf6-98f7017f75c1-kube-api-access-nbfn5\") pod \"lws-controller-manager-5546797fcb-8qtg9\" (UID: \"5178d3db-9114-4856-bbf6-98f7017f75c1\") " pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:39.992977 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.992959 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:39.997624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.997602 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 15:33:39.997959 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.997939 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 15:33:39.998044 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.997961 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xldzm\"" Jun 02 15:33:39.998096 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.998062 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 15:33:39.998298 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:39.998230 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 15:33:40.020858 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.020834 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk"] Jun 02 15:33:40.045074 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.045044 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:40.074018 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.073987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.074167 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.074050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9mx\" (UniqueName: \"kubernetes.io/projected/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-kube-api-access-9d9mx\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.074167 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.074107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-tmp\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.081504 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.081472 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t"] Jun 02 15:33:40.085261 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.085197 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.089896 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.089871 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 15:33:40.090024 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.089926 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tfcnr\"" Jun 02 15:33:40.090024 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.089976 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 15:33:40.125122 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.125096 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t"] Jun 02 15:33:40.174870 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.174830 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9mx\" (UniqueName: \"kubernetes.io/projected/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-kube-api-access-9d9mx\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.175053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.174888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.175053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.174931 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-tmp\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.175053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.174960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.175053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.175026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kh8\" (UniqueName: \"kubernetes.io/projected/1a76201b-182a-45ef-a887-1e1bb012ca7d-kube-api-access-x5kh8\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.175263 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.175172 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.178154 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.178131 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-tmp\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.178425 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.178403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.197562 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.197535 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9mx\" (UniqueName: \"kubernetes.io/projected/b2433887-4d33-4c10-b5bf-2ad46c9b3a72-kube-api-access-9d9mx\") pod \"kube-auth-proxy-66bcfb9d8b-7xckk\" (UID: \"b2433887-4d33-4c10-b5bf-2ad46c9b3a72\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.237728 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.237699 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9"] Jun 02 15:33:40.245726 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:33:40.245690 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5178d3db_9114_4856_bbf6_98f7017f75c1.slice/crio-89d7901bff8c008dafc2b00f7eaea57c3b912cff750cc6321a38e8cd820e6455 WatchSource:0}: Error finding container 89d7901bff8c008dafc2b00f7eaea57c3b912cff750cc6321a38e8cd820e6455: Status 404 returned error can't find the container with id 89d7901bff8c008dafc2b00f7eaea57c3b912cff750cc6321a38e8cd820e6455 Jun 02 15:33:40.276663 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.276627 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.276803 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.276680 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.276803 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.276750 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kh8\" (UniqueName: \"kubernetes.io/projected/1a76201b-182a-45ef-a887-1e1bb012ca7d-kube-api-access-x5kh8\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.277053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.277030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.277116 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.277077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.307865 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.307834 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" Jun 02 15:33:40.328056 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.328026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kh8\" (UniqueName: \"kubernetes.io/projected/1a76201b-182a-45ef-a887-1e1bb012ca7d-kube-api-access-x5kh8\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.395936 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.395908 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:40.450968 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.450930 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk"] Jun 02 15:33:40.455194 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:33:40.455072 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2433887_4d33_4c10_b5bf_2ad46c9b3a72.slice/crio-98ea6a2ed569a341026ea337094162281aa07805d321c7760a050f570f73ef4b WatchSource:0}: Error finding container 98ea6a2ed569a341026ea337094162281aa07805d321c7760a050f570f73ef4b: Status 404 returned error can't find the container with id 98ea6a2ed569a341026ea337094162281aa07805d321c7760a050f570f73ef4b Jun 02 15:33:40.588421 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.588289 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t"] Jun 02 15:33:40.591155 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:33:40.591125 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a76201b_182a_45ef_a887_1e1bb012ca7d.slice/crio-8982f6f1700e5085048539a6b4a9081ca676d8cef349c20fab4af0be2c6cf75b WatchSource:0}: Error finding container 8982f6f1700e5085048539a6b4a9081ca676d8cef349c20fab4af0be2c6cf75b: Status 404 returned error can't find the container with id 8982f6f1700e5085048539a6b4a9081ca676d8cef349c20fab4af0be2c6cf75b Jun 02 15:33:40.906768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.906675 2579 generic.go:358] "Generic (PLEG): container finished" podID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerID="1b18e0eb0d45bf7e9811aadc5d10d52b45a38efae7405f19f5935883dc957f71" exitCode=0 Jun 02 15:33:40.906768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.906739 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerDied","Data":"1b18e0eb0d45bf7e9811aadc5d10d52b45a38efae7405f19f5935883dc957f71"} Jun 02 15:33:40.906768 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.906766 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerStarted","Data":"8982f6f1700e5085048539a6b4a9081ca676d8cef349c20fab4af0be2c6cf75b"} Jun 02 15:33:40.907875 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.907841 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" event={"ID":"b2433887-4d33-4c10-b5bf-2ad46c9b3a72","Type":"ContainerStarted","Data":"98ea6a2ed569a341026ea337094162281aa07805d321c7760a050f570f73ef4b"} Jun 02 15:33:40.908982 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:40.908956 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" event={"ID":"5178d3db-9114-4856-bbf6-98f7017f75c1","Type":"ContainerStarted","Data":"89d7901bff8c008dafc2b00f7eaea57c3b912cff750cc6321a38e8cd820e6455"} Jun 02 15:33:41.915785 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:41.915747 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerStarted","Data":"67d539f1d147cb0698751d1619b0a911f469bcf5e0f9caf4378890329cf96222"} Jun 02 15:33:42.921409 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:42.921367 2579 generic.go:358] "Generic (PLEG): container finished" podID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerID="67d539f1d147cb0698751d1619b0a911f469bcf5e0f9caf4378890329cf96222" exitCode=0 Jun 02 15:33:42.921980 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:42.921464 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerDied","Data":"67d539f1d147cb0698751d1619b0a911f469bcf5e0f9caf4378890329cf96222"} Jun 02 15:33:43.927021 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:43.926982 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerStarted","Data":"994a2b4ad4d716efc3b38d8135f5a6bb7c3f78b2e04a35855139cfbb1e04d298"} Jun 02 15:33:43.928842 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:43.928814 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" event={"ID":"b2433887-4d33-4c10-b5bf-2ad46c9b3a72","Type":"ContainerStarted","Data":"a6926aa667a19042480c383d26d53bad224b187ce72cb2d1a69c553adae5ee17"} Jun 02 15:33:43.930437 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:43.930414 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" event={"ID":"5178d3db-9114-4856-bbf6-98f7017f75c1","Type":"ContainerStarted","Data":"a31c8921c893d2b8ca4e40106a8b0f69a0118f669d76a891da22f96be24b0e4c"} Jun 02 15:33:43.930554 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:43.930486 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:43.954754 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:43.954692 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" podStartSLOduration=3.149874319 podStartE2EDuration="3.954676288s" podCreationTimestamp="2026-06-02 15:33:40 +0000 UTC" firstStartedPulling="2026-06-02 15:33:40.907988577 +0000 UTC m=+587.513681252" lastFinishedPulling="2026-06-02 15:33:41.712790546 +0000 UTC m=+588.318483221" observedRunningTime="2026-06-02 15:33:43.952521862 +0000 UTC m=+590.558214550" watchObservedRunningTime="2026-06-02 15:33:43.954676288 +0000 UTC m=+590.560368983" Jun 02 15:33:43.983241 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:43.983196 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-7xckk" podStartSLOduration=1.633389454 podStartE2EDuration="4.983185357s" podCreationTimestamp="2026-06-02 15:33:39 +0000 UTC" firstStartedPulling="2026-06-02 15:33:40.458041127 +0000 UTC m=+587.063733809" lastFinishedPulling="2026-06-02 15:33:43.807837025 +0000 UTC m=+590.413529712" observedRunningTime="2026-06-02 15:33:43.981366551 +0000 UTC m=+590.587059244" watchObservedRunningTime="2026-06-02 15:33:43.983185357 +0000 UTC m=+590.588878050" Jun 02 15:33:44.936321 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:44.936285 2579 generic.go:358] "Generic (PLEG): container finished" podID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerID="994a2b4ad4d716efc3b38d8135f5a6bb7c3f78b2e04a35855139cfbb1e04d298" exitCode=0 Jun 02 15:33:44.936805 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:44.936373 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerDied","Data":"994a2b4ad4d716efc3b38d8135f5a6bb7c3f78b2e04a35855139cfbb1e04d298"} Jun 02 15:33:44.959005 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:44.958957 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" podStartSLOduration=2.44598789 podStartE2EDuration="5.958941223s" podCreationTimestamp="2026-06-02 15:33:39 +0000 UTC" firstStartedPulling="2026-06-02 15:33:40.247740821 +0000 UTC m=+586.853433508" lastFinishedPulling="2026-06-02 15:33:43.760694155 +0000 UTC m=+590.366386841" observedRunningTime="2026-06-02 15:33:44.040643266 +0000 UTC m=+590.646335959" watchObservedRunningTime="2026-06-02 15:33:44.958941223 +0000 UTC m=+591.564633917" Jun 02 15:33:46.083080 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.083057 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:46.234225 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.234140 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5kh8\" (UniqueName: \"kubernetes.io/projected/1a76201b-182a-45ef-a887-1e1bb012ca7d-kube-api-access-x5kh8\") pod \"1a76201b-182a-45ef-a887-1e1bb012ca7d\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " Jun 02 15:33:46.234225 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.234188 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-util\") pod \"1a76201b-182a-45ef-a887-1e1bb012ca7d\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " Jun 02 15:33:46.234225 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.234217 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-bundle\") pod \"1a76201b-182a-45ef-a887-1e1bb012ca7d\" (UID: \"1a76201b-182a-45ef-a887-1e1bb012ca7d\") " Jun 02 15:33:46.235303 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.235272 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-bundle" (OuterVolumeSpecName: "bundle") pod "1a76201b-182a-45ef-a887-1e1bb012ca7d" (UID: "1a76201b-182a-45ef-a887-1e1bb012ca7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:33:46.236492 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.236462 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a76201b-182a-45ef-a887-1e1bb012ca7d-kube-api-access-x5kh8" (OuterVolumeSpecName: "kube-api-access-x5kh8") pod "1a76201b-182a-45ef-a887-1e1bb012ca7d" (UID: "1a76201b-182a-45ef-a887-1e1bb012ca7d"). InnerVolumeSpecName "kube-api-access-x5kh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:33:46.238299 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.238267 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-util" (OuterVolumeSpecName: "util") pod "1a76201b-182a-45ef-a887-1e1bb012ca7d" (UID: "1a76201b-182a-45ef-a887-1e1bb012ca7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:33:46.335743 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.335703 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:33:46.335743 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.335737 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5kh8\" (UniqueName: \"kubernetes.io/projected/1a76201b-182a-45ef-a887-1e1bb012ca7d-kube-api-access-x5kh8\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:33:46.335743 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.335752 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a76201b-182a-45ef-a887-1e1bb012ca7d-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:33:46.945783 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.945752 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" event={"ID":"1a76201b-182a-45ef-a887-1e1bb012ca7d","Type":"ContainerDied","Data":"8982f6f1700e5085048539a6b4a9081ca676d8cef349c20fab4af0be2c6cf75b"} Jun 02 15:33:46.945783 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.945767 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835v6r4t" Jun 02 15:33:46.945783 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:46.945783 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8982f6f1700e5085048539a6b4a9081ca676d8cef349c20fab4af0be2c6cf75b" Jun 02 15:33:53.935752 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:53.935722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:33:53.936729 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:53.936708 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:33:54.939530 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:54.939492 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5546797fcb-8qtg9" Jun 02 15:33:55.452597 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452545 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8"] Jun 02 15:33:55.452907 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452895 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="pull" Jun 02 15:33:55.452950 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452909 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="pull" Jun 02 15:33:55.452950 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452925 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="extract" Jun 02 15:33:55.452950 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452931 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="extract" Jun 02 15:33:55.452950 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452942 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="util" Jun 02 15:33:55.452950 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.452947 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="util" Jun 02 15:33:55.453129 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.453005 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a76201b-182a-45ef-a887-1e1bb012ca7d" containerName="extract" Jun 02 15:33:55.456325 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.456307 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.460536 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.460517 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 15:33:55.460663 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.460634 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tfcnr\"" Jun 02 15:33:55.460722 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.460671 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 15:33:55.472408 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.472389 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8"] Jun 02 15:33:55.622499 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.622471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phtmg\" (UniqueName: \"kubernetes.io/projected/056147d3-31c5-43ed-ad08-5fab9de8c331-kube-api-access-phtmg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.622680 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.622556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.622680 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.622641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.723686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.723610 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.723686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.723653 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.723861 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.723691 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phtmg\" (UniqueName: \"kubernetes.io/projected/056147d3-31c5-43ed-ad08-5fab9de8c331-kube-api-access-phtmg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.723973 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.723955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.724013 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.723986 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:55.847283 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:55.847248 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phtmg\" (UniqueName: \"kubernetes.io/projected/056147d3-31c5-43ed-ad08-5fab9de8c331-kube-api-access-phtmg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:56.065495 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:56.065420 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:33:56.250599 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:56.250437 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8"] Jun 02 15:33:56.253285 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:33:56.253256 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056147d3_31c5_43ed_ad08_5fab9de8c331.slice/crio-a1aa2f59b040227fd55af9d49c8e10175abdc208a9124080be09856b6c296e6b WatchSource:0}: Error finding container a1aa2f59b040227fd55af9d49c8e10175abdc208a9124080be09856b6c296e6b: Status 404 returned error can't find the container with id a1aa2f59b040227fd55af9d49c8e10175abdc208a9124080be09856b6c296e6b Jun 02 15:33:56.984222 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:56.984187 2579 generic.go:358] "Generic (PLEG): container finished" podID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerID="2434753711fe4c9224a6252a285b78a1b10e95fff45f02368ab1587790ea5b70" exitCode=0 Jun 02 15:33:56.984413 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:56.984273 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" event={"ID":"056147d3-31c5-43ed-ad08-5fab9de8c331","Type":"ContainerDied","Data":"2434753711fe4c9224a6252a285b78a1b10e95fff45f02368ab1587790ea5b70"} Jun 02 15:33:56.984413 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:56.984308 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" event={"ID":"056147d3-31c5-43ed-ad08-5fab9de8c331","Type":"ContainerStarted","Data":"a1aa2f59b040227fd55af9d49c8e10175abdc208a9124080be09856b6c296e6b"} Jun 02 15:33:57.990750 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:57.990716 2579 generic.go:358] "Generic (PLEG): container finished" podID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerID="dd23ee147500bd60a96e162777460dbcde9e7bf202f9cc9b9a18abd9fddf96fe" exitCode=0 Jun 02 15:33:57.991201 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:57.990806 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" event={"ID":"056147d3-31c5-43ed-ad08-5fab9de8c331","Type":"ContainerDied","Data":"dd23ee147500bd60a96e162777460dbcde9e7bf202f9cc9b9a18abd9fddf96fe"} Jun 02 15:33:58.996419 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:58.996379 2579 generic.go:358] "Generic (PLEG): container finished" podID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerID="14c70a67569228d0f5cb9758005a036c719dbecc555c40584386aa3fff3e90a4" exitCode=0 Jun 02 15:33:58.996827 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:33:58.996526 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" event={"ID":"056147d3-31c5-43ed-ad08-5fab9de8c331","Type":"ContainerDied","Data":"14c70a67569228d0f5cb9758005a036c719dbecc555c40584386aa3fff3e90a4"} Jun 02 15:34:00.132107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.132084 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:34:00.165992 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.165956 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-util\") pod \"056147d3-31c5-43ed-ad08-5fab9de8c331\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " Jun 02 15:34:00.166137 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.166042 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-bundle\") pod \"056147d3-31c5-43ed-ad08-5fab9de8c331\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " Jun 02 15:34:00.166137 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.166078 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phtmg\" (UniqueName: \"kubernetes.io/projected/056147d3-31c5-43ed-ad08-5fab9de8c331-kube-api-access-phtmg\") pod \"056147d3-31c5-43ed-ad08-5fab9de8c331\" (UID: \"056147d3-31c5-43ed-ad08-5fab9de8c331\") " Jun 02 15:34:00.166888 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.166862 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-bundle" (OuterVolumeSpecName: "bundle") pod "056147d3-31c5-43ed-ad08-5fab9de8c331" (UID: "056147d3-31c5-43ed-ad08-5fab9de8c331"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:34:00.168397 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.168370 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056147d3-31c5-43ed-ad08-5fab9de8c331-kube-api-access-phtmg" (OuterVolumeSpecName: "kube-api-access-phtmg") pod "056147d3-31c5-43ed-ad08-5fab9de8c331" (UID: "056147d3-31c5-43ed-ad08-5fab9de8c331"). InnerVolumeSpecName "kube-api-access-phtmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:34:00.171542 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.171518 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-util" (OuterVolumeSpecName: "util") pod "056147d3-31c5-43ed-ad08-5fab9de8c331" (UID: "056147d3-31c5-43ed-ad08-5fab9de8c331"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:34:00.267282 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.267204 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:34:00.267282 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.267232 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phtmg\" (UniqueName: \"kubernetes.io/projected/056147d3-31c5-43ed-ad08-5fab9de8c331-kube-api-access-phtmg\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:34:00.267282 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:00.267244 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/056147d3-31c5-43ed-ad08-5fab9de8c331-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:34:01.006441 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:01.006404 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" event={"ID":"056147d3-31c5-43ed-ad08-5fab9de8c331","Type":"ContainerDied","Data":"a1aa2f59b040227fd55af9d49c8e10175abdc208a9124080be09856b6c296e6b"} Jun 02 15:34:01.006441 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:01.006438 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4n5d8" Jun 02 15:34:01.006441 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:34:01.006445 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1aa2f59b040227fd55af9d49c8e10175abdc208a9124080be09856b6c296e6b" Jun 02 15:35:01.962368 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962331 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn"] Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962698 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="extract" Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962710 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="extract" Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962724 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="util" Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962729 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="util" Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962737 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="pull" Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962742 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="pull" Jun 02 15:35:01.962857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.962799 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="056147d3-31c5-43ed-ad08-5fab9de8c331" containerName="extract" Jun 02 15:35:01.965193 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.965174 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:01.967917 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.967900 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 15:35:01.968921 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.968900 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhqjm\"" Jun 02 15:35:01.969035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.968902 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 15:35:01.973926 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:01.973904 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn"] Jun 02 15:35:02.006736 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.006702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.006885 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.006782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7gtc\" (UniqueName: \"kubernetes.io/projected/d9825baa-1676-4701-a54d-14c9a7ea7a0b-kube-api-access-q7gtc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.006885 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.006835 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.073379 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.073343 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb"] Jun 02 15:35:02.076041 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.076025 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.086442 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.086420 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb"] Jun 02 15:35:02.107244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107215 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7gtc\" (UniqueName: \"kubernetes.io/projected/d9825baa-1676-4701-a54d-14c9a7ea7a0b-kube-api-access-q7gtc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.107399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qtb\" (UniqueName: \"kubernetes.io/projected/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-kube-api-access-45qtb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.107399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.107399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107376 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.107562 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.107562 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107449 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.107762 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107739 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.107826 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.107789 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.116537 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.116514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7gtc\" (UniqueName: \"kubernetes.io/projected/d9825baa-1676-4701-a54d-14c9a7ea7a0b-kube-api-access-q7gtc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.167416 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.167379 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp"] Jun 02 15:35:02.170154 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.170132 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.180510 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.180486 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp"] Jun 02 15:35:02.208789 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.208759 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.208974 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.208815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.208974 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.208836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnnr\" (UniqueName: \"kubernetes.io/projected/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-kube-api-access-qhnnr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.208974 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.208934 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45qtb\" (UniqueName: \"kubernetes.io/projected/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-kube-api-access-45qtb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.209144 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.209000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.209144 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.209037 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.209144 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.209109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.209378 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.209356 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.218928 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.218857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qtb\" (UniqueName: \"kubernetes.io/projected/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-kube-api-access-45qtb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.270733 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.270698 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs"] Jun 02 15:35:02.273639 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.273619 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.275829 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.275810 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:02.283679 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.283656 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs"] Jun 02 15:35:02.309506 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309475 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.309715 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309557 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.309715 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309600 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnnr\" (UniqueName: \"kubernetes.io/projected/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-kube-api-access-qhnnr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.309715 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqm4v\" (UniqueName: \"kubernetes.io/projected/5040654a-eccf-45f8-80c0-b2006b22aa95-kube-api-access-zqm4v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.309898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.309898 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.310012 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.309992 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.310062 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.310047 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.319922 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.319894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnnr\" (UniqueName: \"kubernetes.io/projected/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-kube-api-access-qhnnr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.385308 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.385277 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:02.410405 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.410372 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqm4v\" (UniqueName: \"kubernetes.io/projected/5040654a-eccf-45f8-80c0-b2006b22aa95-kube-api-access-zqm4v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.410653 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.410418 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.410653 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.410471 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.411007 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.410917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.411053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.411034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.412461 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.412438 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn"] Jun 02 15:35:02.413949 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:35:02.413920 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9825baa_1676_4701_a54d_14c9a7ea7a0b.slice/crio-21135a781ac5059b27160c1b8ad915b94472f1260b61e038a41b65e998878ca2 WatchSource:0}: Error finding container 21135a781ac5059b27160c1b8ad915b94472f1260b61e038a41b65e998878ca2: Status 404 returned error can't find the container with id 21135a781ac5059b27160c1b8ad915b94472f1260b61e038a41b65e998878ca2 Jun 02 15:35:02.415864 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.415849 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:35:02.420445 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.420426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqm4v\" (UniqueName: \"kubernetes.io/projected/5040654a-eccf-45f8-80c0-b2006b22aa95-kube-api-access-zqm4v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.481367 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.481341 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:02.535174 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.535118 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb"] Jun 02 15:35:02.572989 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:35:02.572953 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e6d6b7_53dc_4f31_852b_2a5ec2fa87e3.slice/crio-ed553341cdb9507e8296db5434cc30bf10ce76bb6f6bd5b45e5a2888799222ec WatchSource:0}: Error finding container ed553341cdb9507e8296db5434cc30bf10ce76bb6f6bd5b45e5a2888799222ec: Status 404 returned error can't find the container with id ed553341cdb9507e8296db5434cc30bf10ce76bb6f6bd5b45e5a2888799222ec Jun 02 15:35:02.584701 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.584673 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:02.642602 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.642473 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp"] Jun 02 15:35:02.756673 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:02.756653 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs"] Jun 02 15:35:03.232040 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.232006 2579 generic.go:358] "Generic (PLEG): container finished" podID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerID="30756305e28d376a43b3401fe0c81b84cc87fe80e1e26bee827d9a404e822eb7" exitCode=0 Jun 02 15:35:03.232476 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.232097 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" event={"ID":"5040654a-eccf-45f8-80c0-b2006b22aa95","Type":"ContainerDied","Data":"30756305e28d376a43b3401fe0c81b84cc87fe80e1e26bee827d9a404e822eb7"} Jun 02 15:35:03.232476 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.232142 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" event={"ID":"5040654a-eccf-45f8-80c0-b2006b22aa95","Type":"ContainerStarted","Data":"fb4119dc15aabfeb4bba3d54362a2a90ab430587f44a4a3ddc1085bcb96e7c47"} Jun 02 15:35:03.233625 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.233599 2579 generic.go:358] "Generic (PLEG): container finished" podID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerID="8c804af19dbcbe58b02c4c9b0fd85824c253a0ecea751180a12a1ea018b556a5" exitCode=0 Jun 02 15:35:03.233750 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.233682 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" event={"ID":"e5a7cb61-bf89-4af5-9e50-8ab60cb70290","Type":"ContainerDied","Data":"8c804af19dbcbe58b02c4c9b0fd85824c253a0ecea751180a12a1ea018b556a5"} Jun 02 15:35:03.233750 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.233705 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" event={"ID":"e5a7cb61-bf89-4af5-9e50-8ab60cb70290","Type":"ContainerStarted","Data":"6c17e4afc4b99321c9719cd23d0bcf9ac47250593336887923d1dbe324024733"} Jun 02 15:35:03.235078 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.235055 2579 generic.go:358] "Generic (PLEG): container finished" podID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerID="fb86fa32f9928b6da70dfdd27fcc7732849ce0851e1ffeae70b6e94e028ce163" exitCode=0 Jun 02 15:35:03.235197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.235118 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" event={"ID":"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3","Type":"ContainerDied","Data":"fb86fa32f9928b6da70dfdd27fcc7732849ce0851e1ffeae70b6e94e028ce163"} Jun 02 15:35:03.235197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.235152 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" event={"ID":"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3","Type":"ContainerStarted","Data":"ed553341cdb9507e8296db5434cc30bf10ce76bb6f6bd5b45e5a2888799222ec"} Jun 02 15:35:03.236517 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.236495 2579 generic.go:358] "Generic (PLEG): container finished" podID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerID="ad0bd5b6321325d5678f3143970fc713e6fba47cce75a0f1c67029d91a3c584c" exitCode=0 Jun 02 15:35:03.236617 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.236541 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" event={"ID":"d9825baa-1676-4701-a54d-14c9a7ea7a0b","Type":"ContainerDied","Data":"ad0bd5b6321325d5678f3143970fc713e6fba47cce75a0f1c67029d91a3c584c"} Jun 02 15:35:03.236617 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:03.236562 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" event={"ID":"d9825baa-1676-4701-a54d-14c9a7ea7a0b","Type":"ContainerStarted","Data":"21135a781ac5059b27160c1b8ad915b94472f1260b61e038a41b65e998878ca2"} Jun 02 15:35:05.246052 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.246017 2579 generic.go:358] "Generic (PLEG): container finished" podID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerID="7c37422ad012ef3de8a1d124a2d523eccfc420204fb65b953665a25079302091" exitCode=0 Jun 02 15:35:05.246466 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.246100 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" event={"ID":"5040654a-eccf-45f8-80c0-b2006b22aa95","Type":"ContainerDied","Data":"7c37422ad012ef3de8a1d124a2d523eccfc420204fb65b953665a25079302091"} Jun 02 15:35:05.247867 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.247842 2579 generic.go:358] "Generic (PLEG): container finished" podID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerID="27b3c6ce33bdc6fafea5c703ff3ff991a0310a98a785e8cae086fae10d93846a" exitCode=0 Jun 02 15:35:05.247989 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.247965 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" event={"ID":"e5a7cb61-bf89-4af5-9e50-8ab60cb70290","Type":"ContainerDied","Data":"27b3c6ce33bdc6fafea5c703ff3ff991a0310a98a785e8cae086fae10d93846a"} Jun 02 15:35:05.249686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.249662 2579 generic.go:358] "Generic (PLEG): container finished" podID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerID="fd9142d098596bf1c835d25ba605bf6c4f85ac410384216093e0f5e9c9301a13" exitCode=0 Jun 02 15:35:05.249774 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.249736 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" event={"ID":"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3","Type":"ContainerDied","Data":"fd9142d098596bf1c835d25ba605bf6c4f85ac410384216093e0f5e9c9301a13"} Jun 02 15:35:05.251530 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.251492 2579 generic.go:358] "Generic (PLEG): container finished" podID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerID="c3165a9acabfcd54862a3c985836a25a6fff76d78586e631fd704e4cbfd267f1" exitCode=0 Jun 02 15:35:05.251634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:05.251518 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" event={"ID":"d9825baa-1676-4701-a54d-14c9a7ea7a0b","Type":"ContainerDied","Data":"c3165a9acabfcd54862a3c985836a25a6fff76d78586e631fd704e4cbfd267f1"} Jun 02 15:35:06.257869 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.257834 2579 generic.go:358] "Generic (PLEG): container finished" podID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerID="c086b4e1702e4e7345464696805de575a4a648e40dc10b3b950a5c97c0a28f36" exitCode=0 Jun 02 15:35:06.258311 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.257909 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" event={"ID":"5040654a-eccf-45f8-80c0-b2006b22aa95","Type":"ContainerDied","Data":"c086b4e1702e4e7345464696805de575a4a648e40dc10b3b950a5c97c0a28f36"} Jun 02 15:35:06.259887 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.259863 2579 generic.go:358] "Generic (PLEG): container finished" podID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerID="df0f2331fa76901693d4396b258ba5a3df15b5024f57c82c95d79fdc7e13b782" exitCode=0 Jun 02 15:35:06.260016 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.259991 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" event={"ID":"e5a7cb61-bf89-4af5-9e50-8ab60cb70290","Type":"ContainerDied","Data":"df0f2331fa76901693d4396b258ba5a3df15b5024f57c82c95d79fdc7e13b782"} Jun 02 15:35:06.261956 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.261934 2579 generic.go:358] "Generic (PLEG): container finished" podID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerID="6d61774e6716f1f1451faf2d7d57a8bba3e0a8f9f03cce98327976ad34ee59d6" exitCode=0 Jun 02 15:35:06.262050 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.262015 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" event={"ID":"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3","Type":"ContainerDied","Data":"6d61774e6716f1f1451faf2d7d57a8bba3e0a8f9f03cce98327976ad34ee59d6"} Jun 02 15:35:06.263995 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.263964 2579 generic.go:358] "Generic (PLEG): container finished" podID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerID="604b420f1b62301248e2d8f5ce5d6145e24dbbe1f9db6848711c1b9be4e7dc14" exitCode=0 Jun 02 15:35:06.263995 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:06.263994 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" event={"ID":"d9825baa-1676-4701-a54d-14c9a7ea7a0b","Type":"ContainerDied","Data":"604b420f1b62301248e2d8f5ce5d6145e24dbbe1f9db6848711c1b9be4e7dc14"} Jun 02 15:35:07.419913 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.419885 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:07.464995 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.464976 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:07.469360 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.469333 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:07.472682 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.472661 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:07.562142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562069 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-util\") pod \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " Jun 02 15:35:07.562142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562099 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-util\") pod \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " Jun 02 15:35:07.562142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562129 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-util\") pod \"5040654a-eccf-45f8-80c0-b2006b22aa95\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " Jun 02 15:35:07.562405 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562156 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7gtc\" (UniqueName: \"kubernetes.io/projected/d9825baa-1676-4701-a54d-14c9a7ea7a0b-kube-api-access-q7gtc\") pod \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " Jun 02 15:35:07.562405 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562172 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-util\") pod \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " Jun 02 15:35:07.562405 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562193 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-bundle\") pod \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " Jun 02 15:35:07.562405 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562210 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqm4v\" (UniqueName: \"kubernetes.io/projected/5040654a-eccf-45f8-80c0-b2006b22aa95-kube-api-access-zqm4v\") pod \"5040654a-eccf-45f8-80c0-b2006b22aa95\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " Jun 02 15:35:07.562405 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562228 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45qtb\" (UniqueName: \"kubernetes.io/projected/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-kube-api-access-45qtb\") pod \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\" (UID: \"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3\") " Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562829 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-bundle\") pod \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\" (UID: \"d9825baa-1676-4701-a54d-14c9a7ea7a0b\") " Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562960 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhnnr\" (UniqueName: \"kubernetes.io/projected/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-kube-api-access-qhnnr\") pod \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562962 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-bundle" (OuterVolumeSpecName: "bundle") pod "a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" (UID: "a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.562987 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-bundle\") pod \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\" (UID: \"e5a7cb61-bf89-4af5-9e50-8ab60cb70290\") " Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.563015 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-bundle\") pod \"5040654a-eccf-45f8-80c0-b2006b22aa95\" (UID: \"5040654a-eccf-45f8-80c0-b2006b22aa95\") " Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.563299 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.563566 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-bundle" (OuterVolumeSpecName: "bundle") pod "d9825baa-1676-4701-a54d-14c9a7ea7a0b" (UID: "d9825baa-1676-4701-a54d-14c9a7ea7a0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.563825 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-bundle" (OuterVolumeSpecName: "bundle") pod "5040654a-eccf-45f8-80c0-b2006b22aa95" (UID: "5040654a-eccf-45f8-80c0-b2006b22aa95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.564720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.564663 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-bundle" (OuterVolumeSpecName: "bundle") pod "e5a7cb61-bf89-4af5-9e50-8ab60cb70290" (UID: "e5a7cb61-bf89-4af5-9e50-8ab60cb70290"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.565413 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.565028 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5040654a-eccf-45f8-80c0-b2006b22aa95-kube-api-access-zqm4v" (OuterVolumeSpecName: "kube-api-access-zqm4v") pod "5040654a-eccf-45f8-80c0-b2006b22aa95" (UID: "5040654a-eccf-45f8-80c0-b2006b22aa95"). InnerVolumeSpecName "kube-api-access-zqm4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:35:07.565413 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.565332 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9825baa-1676-4701-a54d-14c9a7ea7a0b-kube-api-access-q7gtc" (OuterVolumeSpecName: "kube-api-access-q7gtc") pod "d9825baa-1676-4701-a54d-14c9a7ea7a0b" (UID: "d9825baa-1676-4701-a54d-14c9a7ea7a0b"). InnerVolumeSpecName "kube-api-access-q7gtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:35:07.566304 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.566259 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-kube-api-access-qhnnr" (OuterVolumeSpecName: "kube-api-access-qhnnr") pod "e5a7cb61-bf89-4af5-9e50-8ab60cb70290" (UID: "e5a7cb61-bf89-4af5-9e50-8ab60cb70290"). InnerVolumeSpecName "kube-api-access-qhnnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:35:07.566727 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.566695 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-kube-api-access-45qtb" (OuterVolumeSpecName: "kube-api-access-45qtb") pod "a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" (UID: "a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3"). InnerVolumeSpecName "kube-api-access-45qtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:35:07.568972 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.568941 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-util" (OuterVolumeSpecName: "util") pod "a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" (UID: "a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.569399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.569376 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-util" (OuterVolumeSpecName: "util") pod "5040654a-eccf-45f8-80c0-b2006b22aa95" (UID: "5040654a-eccf-45f8-80c0-b2006b22aa95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.569638 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.569618 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-util" (OuterVolumeSpecName: "util") pod "e5a7cb61-bf89-4af5-9e50-8ab60cb70290" (UID: "e5a7cb61-bf89-4af5-9e50-8ab60cb70290"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.569947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.569929 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-util" (OuterVolumeSpecName: "util") pod "d9825baa-1676-4701-a54d-14c9a7ea7a0b" (UID: "d9825baa-1676-4701-a54d-14c9a7ea7a0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:07.664231 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664195 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqm4v\" (UniqueName: \"kubernetes.io/projected/5040654a-eccf-45f8-80c0-b2006b22aa95-kube-api-access-zqm4v\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664231 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664230 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45qtb\" (UniqueName: \"kubernetes.io/projected/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-kube-api-access-45qtb\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664231 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664244 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664261 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhnnr\" (UniqueName: \"kubernetes.io/projected/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-kube-api-access-qhnnr\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664273 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664285 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664295 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664305 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a7cb61-bf89-4af5-9e50-8ab60cb70290-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664315 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040654a-eccf-45f8-80c0-b2006b22aa95-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664326 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7gtc\" (UniqueName: \"kubernetes.io/projected/d9825baa-1676-4701-a54d-14c9a7ea7a0b-kube-api-access-q7gtc\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:07.664487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:07.664337 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9825baa-1676-4701-a54d-14c9a7ea7a0b-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:08.274513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.274471 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" event={"ID":"a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3","Type":"ContainerDied","Data":"ed553341cdb9507e8296db5434cc30bf10ce76bb6f6bd5b45e5a2888799222ec"} Jun 02 15:35:08.274513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.274505 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb" Jun 02 15:35:08.274513 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.274513 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed553341cdb9507e8296db5434cc30bf10ce76bb6f6bd5b45e5a2888799222ec" Jun 02 15:35:08.279166 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.279125 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" event={"ID":"d9825baa-1676-4701-a54d-14c9a7ea7a0b","Type":"ContainerDied","Data":"21135a781ac5059b27160c1b8ad915b94472f1260b61e038a41b65e998878ca2"} Jun 02 15:35:08.279299 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.279172 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21135a781ac5059b27160c1b8ad915b94472f1260b61e038a41b65e998878ca2" Jun 02 15:35:08.279376 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.279326 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn" Jun 02 15:35:08.281296 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.281264 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" event={"ID":"5040654a-eccf-45f8-80c0-b2006b22aa95","Type":"ContainerDied","Data":"fb4119dc15aabfeb4bba3d54362a2a90ab430587f44a4a3ddc1085bcb96e7c47"} Jun 02 15:35:08.281436 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.281299 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb4119dc15aabfeb4bba3d54362a2a90ab430587f44a4a3ddc1085bcb96e7c47" Jun 02 15:35:08.281436 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.281432 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs" Jun 02 15:35:08.283695 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.283663 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" event={"ID":"e5a7cb61-bf89-4af5-9e50-8ab60cb70290","Type":"ContainerDied","Data":"6c17e4afc4b99321c9719cd23d0bcf9ac47250593336887923d1dbe324024733"} Jun 02 15:35:08.283835 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.283698 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c17e4afc4b99321c9719cd23d0bcf9ac47250593336887923d1dbe324024733" Jun 02 15:35:08.283835 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:08.283672 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp" Jun 02 15:35:22.194823 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.194787 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw"] Jun 02 15:35:22.195197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195150 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="extract" Jun 02 15:35:22.195197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195162 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="extract" Jun 02 15:35:22.195197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195178 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="util" Jun 02 15:35:22.195197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195184 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="util" Jun 02 15:35:22.195197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195191 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="pull" Jun 02 15:35:22.195197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195196 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195203 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195209 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195216 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195220 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195228 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195233 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195241 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="util" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195245 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="util" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195253 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195258 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195263 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="util" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195267 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="util" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195275 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="util" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195280 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="util" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195285 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195289 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195295 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195300 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="pull" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195344 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5a7cb61-bf89-4af5-9e50-8ab60cb70290" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195351 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195358 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5040654a-eccf-45f8-80c0-b2006b22aa95" containerName="extract" Jun 02 15:35:22.195387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.195368 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9825baa-1676-4701-a54d-14c9a7ea7a0b" containerName="extract" Jun 02 15:35:22.198390 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.198373 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:22.201864 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.201841 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 15:35:22.202012 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.201882 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 15:35:22.202244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.202227 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 15:35:22.203074 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.203060 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bcx6q\"" Jun 02 15:35:22.218134 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.218113 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw"] Jun 02 15:35:22.299464 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.299425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwjlj\" (UniqueName: \"kubernetes.io/projected/e282b26a-e63a-4381-9534-9e78cabf2cad-kube-api-access-dwjlj\") pod \"dns-operator-controller-manager-648d5c98bc-x2zzw\" (UID: \"e282b26a-e63a-4381-9534-9e78cabf2cad\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:22.400949 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.400916 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwjlj\" (UniqueName: \"kubernetes.io/projected/e282b26a-e63a-4381-9534-9e78cabf2cad-kube-api-access-dwjlj\") pod \"dns-operator-controller-manager-648d5c98bc-x2zzw\" (UID: \"e282b26a-e63a-4381-9534-9e78cabf2cad\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:22.415773 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.415741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwjlj\" (UniqueName: \"kubernetes.io/projected/e282b26a-e63a-4381-9534-9e78cabf2cad-kube-api-access-dwjlj\") pod \"dns-operator-controller-manager-648d5c98bc-x2zzw\" (UID: \"e282b26a-e63a-4381-9534-9e78cabf2cad\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:22.509348 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.509240 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:22.666474 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:22.666440 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw"] Jun 02 15:35:22.676547 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:35:22.676519 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode282b26a_e63a_4381_9534_9e78cabf2cad.slice/crio-8654a4c51b726a7c61466dbd7d84b431c755f288336adbcbd26eea1d68b60d62 WatchSource:0}: Error finding container 8654a4c51b726a7c61466dbd7d84b431c755f288336adbcbd26eea1d68b60d62: Status 404 returned error can't find the container with id 8654a4c51b726a7c61466dbd7d84b431c755f288336adbcbd26eea1d68b60d62 Jun 02 15:35:23.348643 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:23.348601 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" event={"ID":"e282b26a-e63a-4381-9534-9e78cabf2cad","Type":"ContainerStarted","Data":"8654a4c51b726a7c61466dbd7d84b431c755f288336adbcbd26eea1d68b60d62"} Jun 02 15:35:25.358362 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:25.358328 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" event={"ID":"e282b26a-e63a-4381-9534-9e78cabf2cad","Type":"ContainerStarted","Data":"001769b2e0f7b42eb4dfa2aa5d75699e0d40d187a207d1680a16501078317cef"} Jun 02 15:35:25.358780 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:25.358440 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:25.387134 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:25.387083 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" podStartSLOduration=1.252608941 podStartE2EDuration="3.387066046s" podCreationTimestamp="2026-06-02 15:35:22 +0000 UTC" firstStartedPulling="2026-06-02 15:35:22.678919915 +0000 UTC m=+689.284612593" lastFinishedPulling="2026-06-02 15:35:24.813377023 +0000 UTC m=+691.419069698" observedRunningTime="2026-06-02 15:35:25.38637727 +0000 UTC m=+691.992069965" watchObservedRunningTime="2026-06-02 15:35:25.387066046 +0000 UTC m=+691.992758740" Jun 02 15:35:28.821534 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.821496 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w"] Jun 02 15:35:28.825106 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.825083 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:28.827658 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.827638 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 15:35:28.827658 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.827649 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 15:35:28.827950 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.827935 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhqjm\"" Jun 02 15:35:28.838702 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.838678 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w"] Jun 02 15:35:28.961223 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.961183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:28.961409 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.961272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:28.961409 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:28.961314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhq9k\" (UniqueName: \"kubernetes.io/projected/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-kube-api-access-bhq9k\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.062240 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.062198 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.062429 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.062252 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhq9k\" (UniqueName: \"kubernetes.io/projected/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-kube-api-access-bhq9k\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.062429 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.062334 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.062999 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.062971 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.064732 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.064716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.073420 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.073340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhq9k\" (UniqueName: \"kubernetes.io/projected/de628d92-bfdc-490f-a4ee-0fb7a0b54f51-kube-api-access-bhq9k\") pod \"kuadrant-console-plugin-6cb54b5c86-rn89w\" (UID: \"de628d92-bfdc-490f-a4ee-0fb7a0b54f51\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.134312 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.134278 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" Jun 02 15:35:29.271260 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.271224 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w"] Jun 02 15:35:29.274662 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:35:29.274636 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde628d92_bfdc_490f_a4ee_0fb7a0b54f51.slice/crio-3dd26e69a0b55fd7d37455ed06dd0febbfeebdc0b9ce4954257c39aecb65e3cd WatchSource:0}: Error finding container 3dd26e69a0b55fd7d37455ed06dd0febbfeebdc0b9ce4954257c39aecb65e3cd: Status 404 returned error can't find the container with id 3dd26e69a0b55fd7d37455ed06dd0febbfeebdc0b9ce4954257c39aecb65e3cd Jun 02 15:35:29.377226 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:29.377196 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" event={"ID":"de628d92-bfdc-490f-a4ee-0fb7a0b54f51","Type":"ContainerStarted","Data":"3dd26e69a0b55fd7d37455ed06dd0febbfeebdc0b9ce4954257c39aecb65e3cd"} Jun 02 15:35:36.365164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:36.365132 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-x2zzw" Jun 02 15:35:39.425816 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.425784 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6"] Jun 02 15:35:39.430878 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.430857 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:39.433632 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.433607 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h62zn\"" Jun 02 15:35:39.444323 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.444303 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6"] Jun 02 15:35:39.448529 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.448505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhdcr\" (UniqueName: \"kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:39.448667 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.448636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589f50c-7e7f-4928-8d87-4b024303f39f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:39.472067 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.472030 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6"] Jun 02 15:35:39.472671 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:35:39.472638 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mhdcr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" podUID="0589f50c-7e7f-4928-8d87-4b024303f39f" Jun 02 15:35:39.490836 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.490804 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6"] Jun 02 15:35:39.511764 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.511732 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs"] Jun 02 15:35:39.515745 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.515718 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.532874 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.532847 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs"] Jun 02 15:35:39.549629 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.549559 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhdcr\" (UniqueName: \"kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:39.549793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.549702 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589f50c-7e7f-4928-8d87-4b024303f39f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:39.549793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.549737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2hh\" (UniqueName: \"kubernetes.io/projected/3d4bfaa1-afae-4c23-bb83-0d1dba036cfe-kube-api-access-hj2hh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jcrjs\" (UID: \"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.549793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.549780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d4bfaa1-afae-4c23-bb83-0d1dba036cfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jcrjs\" (UID: \"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.550193 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.550170 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589f50c-7e7f-4928-8d87-4b024303f39f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:39.561588 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:35:39.561552 2579 projected.go:194] Error preparing data for projected volume kube-api-access-mhdcr for pod kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6: failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-7wdq6" not found Jun 02 15:35:39.561738 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:35:39.561674 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr podName:0589f50c-7e7f-4928-8d87-4b024303f39f nodeName:}" failed. No retries permitted until 2026-06-02 15:35:40.061652472 +0000 UTC m=+706.667345150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhdcr" (UniqueName: "kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr") pod "kuadrant-operator-controller-manager-55c7f4c975-7wdq6" (UID: "0589f50c-7e7f-4928-8d87-4b024303f39f") : failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-7wdq6" not found Jun 02 15:35:39.650466 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.650427 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2hh\" (UniqueName: \"kubernetes.io/projected/3d4bfaa1-afae-4c23-bb83-0d1dba036cfe-kube-api-access-hj2hh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jcrjs\" (UID: \"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.650660 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.650493 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d4bfaa1-afae-4c23-bb83-0d1dba036cfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jcrjs\" (UID: \"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.651120 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.651093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d4bfaa1-afae-4c23-bb83-0d1dba036cfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jcrjs\" (UID: \"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.689914 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.689846 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2hh\" (UniqueName: \"kubernetes.io/projected/3d4bfaa1-afae-4c23-bb83-0d1dba036cfe-kube-api-access-hj2hh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jcrjs\" (UID: \"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.830383 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.830345 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:35:39.979507 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:39.979481 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs"] Jun 02 15:35:39.981344 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:35:39.981320 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4bfaa1_afae_4c23_bb83_0d1dba036cfe.slice/crio-6cc916c12074e1bf09c441fc153d580b1fca7363b2de11f4bfa97ce29b53a8f1 WatchSource:0}: Error finding container 6cc916c12074e1bf09c441fc153d580b1fca7363b2de11f4bfa97ce29b53a8f1: Status 404 returned error can't find the container with id 6cc916c12074e1bf09c441fc153d580b1fca7363b2de11f4bfa97ce29b53a8f1 Jun 02 15:35:40.154588 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.154543 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhdcr\" (UniqueName: \"kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:40.158274 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:35:40.158251 2579 projected.go:194] Error preparing data for projected volume kube-api-access-mhdcr for pod kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6: failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-7wdq6" not found Jun 02 15:35:40.158396 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:35:40.158318 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr podName:0589f50c-7e7f-4928-8d87-4b024303f39f nodeName:}" failed. No retries permitted until 2026-06-02 15:35:41.158300946 +0000 UTC m=+707.763993619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhdcr" (UniqueName: "kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr") pod "kuadrant-operator-controller-manager-55c7f4c975-7wdq6" (UID: "0589f50c-7e7f-4928-8d87-4b024303f39f") : failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-7wdq6" not found Jun 02 15:35:40.427111 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.427084 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:40.427487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.427080 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" event={"ID":"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe","Type":"ContainerStarted","Data":"6cc916c12074e1bf09c441fc153d580b1fca7363b2de11f4bfa97ce29b53a8f1"} Jun 02 15:35:40.431991 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.431963 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:40.434490 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.434466 2579 status_manager.go:895] "Failed to get status for pod" podUID="0589f50c-7e7f-4928-8d87-4b024303f39f" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" is forbidden: User \"system:node:ip-10-0-141-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-151.ec2.internal' and this object" Jun 02 15:35:40.456960 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.456930 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589f50c-7e7f-4928-8d87-4b024303f39f-extensions-socket-volume\") pod \"0589f50c-7e7f-4928-8d87-4b024303f39f\" (UID: \"0589f50c-7e7f-4928-8d87-4b024303f39f\") " Jun 02 15:35:40.457184 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.457170 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhdcr\" (UniqueName: \"kubernetes.io/projected/0589f50c-7e7f-4928-8d87-4b024303f39f-kube-api-access-mhdcr\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:40.457227 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.457171 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0589f50c-7e7f-4928-8d87-4b024303f39f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0589f50c-7e7f-4928-8d87-4b024303f39f" (UID: "0589f50c-7e7f-4928-8d87-4b024303f39f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:35:40.558436 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:40.558354 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0589f50c-7e7f-4928-8d87-4b024303f39f-extensions-socket-volume\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:35:41.431624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:41.431593 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" Jun 02 15:35:41.434700 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:41.434665 2579 status_manager.go:895] "Failed to get status for pod" podUID="0589f50c-7e7f-4928-8d87-4b024303f39f" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" is forbidden: User \"system:node:ip-10-0-141-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-151.ec2.internal' and this object" Jun 02 15:35:41.441377 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:41.441336 2579 status_manager.go:895] "Failed to get status for pod" podUID="0589f50c-7e7f-4928-8d87-4b024303f39f" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7wdq6" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-7wdq6\" is forbidden: User \"system:node:ip-10-0-141-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-151.ec2.internal' and this object" Jun 02 15:35:42.032311 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:42.032281 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0589f50c-7e7f-4928-8d87-4b024303f39f" path="/var/lib/kubelet/pods/0589f50c-7e7f-4928-8d87-4b024303f39f/volumes" Jun 02 15:35:55.491905 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:55.491863 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" event={"ID":"de628d92-bfdc-490f-a4ee-0fb7a0b54f51","Type":"ContainerStarted","Data":"f01a3985348f0217a2aac9b7898f513ab4ff736020c926381b2729d95f5e896a"} Jun 02 15:35:55.513053 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:35:55.512994 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-rn89w" podStartSLOduration=2.0155987 podStartE2EDuration="27.512974549s" podCreationTimestamp="2026-06-02 15:35:28 +0000 UTC" firstStartedPulling="2026-06-02 15:35:29.276445806 +0000 UTC m=+695.882138478" lastFinishedPulling="2026-06-02 15:35:54.77382164 +0000 UTC m=+721.379514327" observedRunningTime="2026-06-02 15:35:55.511173875 +0000 UTC m=+722.116866583" watchObservedRunningTime="2026-06-02 15:35:55.512974549 +0000 UTC m=+722.118667244" Jun 02 15:36:00.513559 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:36:00.513519 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" event={"ID":"3d4bfaa1-afae-4c23-bb83-0d1dba036cfe","Type":"ContainerStarted","Data":"771ea764144045f1fbc35363107c3cbc59ec9084264094df50ae536ba82ba83c"} Jun 02 15:36:00.513947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:36:00.513635 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:36:00.539163 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:36:00.539102 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" podStartSLOduration=1.804627604 podStartE2EDuration="21.539085555s" podCreationTimestamp="2026-06-02 15:35:39 +0000 UTC" firstStartedPulling="2026-06-02 15:35:39.98423251 +0000 UTC m=+706.589925181" lastFinishedPulling="2026-06-02 15:35:59.718690457 +0000 UTC m=+726.324383132" observedRunningTime="2026-06-02 15:36:00.535208558 +0000 UTC m=+727.140901253" watchObservedRunningTime="2026-06-02 15:36:00.539085555 +0000 UTC m=+727.144778248" Jun 02 15:36:11.519701 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:36:11.519664 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jcrjs" Jun 02 15:37:03.675307 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.675272 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp"] Jun 02 15:37:03.677959 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.677941 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.682121 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.682100 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tfcnr\"" Jun 02 15:37:03.683207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.683187 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 15:37:03.683311 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.683229 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 15:37:03.692238 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.692211 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp"] Jun 02 15:37:03.822116 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.822081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.822287 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.822132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfr2f\" (UniqueName: \"kubernetes.io/projected/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-kube-api-access-nfr2f\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.822287 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.822165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.923187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.923145 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.923358 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.923203 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfr2f\" (UniqueName: \"kubernetes.io/projected/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-kube-api-access-nfr2f\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.923399 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.923378 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.923645 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.923621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.923707 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.923691 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.936403 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.936352 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfr2f\" (UniqueName: \"kubernetes.io/projected/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-kube-api-access-nfr2f\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:03.987207 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:03.987174 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:04.142724 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:04.142700 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp"] Jun 02 15:37:04.144992 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:37:04.144959 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a917319_23cc_4f5c_abcf_3e45c2fcb73f.slice/crio-034cdd280bd057dc6e17c8977abe361875b4d85c496818ac040556a298cba8aa WatchSource:0}: Error finding container 034cdd280bd057dc6e17c8977abe361875b4d85c496818ac040556a298cba8aa: Status 404 returned error can't find the container with id 034cdd280bd057dc6e17c8977abe361875b4d85c496818ac040556a298cba8aa Jun 02 15:37:04.764557 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:04.764509 2579 generic.go:358] "Generic (PLEG): container finished" podID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerID="6a4835208064d18271b7f44d9b9f495eab300e6d3e4750d6c115a07e5b8a4cc6" exitCode=0 Jun 02 15:37:04.764997 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:04.764610 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" event={"ID":"0a917319-23cc-4f5c-abcf-3e45c2fcb73f","Type":"ContainerDied","Data":"6a4835208064d18271b7f44d9b9f495eab300e6d3e4750d6c115a07e5b8a4cc6"} Jun 02 15:37:04.764997 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:04.764653 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" event={"ID":"0a917319-23cc-4f5c-abcf-3e45c2fcb73f","Type":"ContainerStarted","Data":"034cdd280bd057dc6e17c8977abe361875b4d85c496818ac040556a298cba8aa"} Jun 02 15:37:05.770624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:05.770514 2579 generic.go:358] "Generic (PLEG): container finished" podID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerID="b64c311208b53de9b8946548bfb4314d7a8c34f3c350f189e43dedfdea73fbca" exitCode=0 Jun 02 15:37:05.770624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:05.770606 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" event={"ID":"0a917319-23cc-4f5c-abcf-3e45c2fcb73f","Type":"ContainerDied","Data":"b64c311208b53de9b8946548bfb4314d7a8c34f3c350f189e43dedfdea73fbca"} Jun 02 15:37:06.776639 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:06.776606 2579 generic.go:358] "Generic (PLEG): container finished" podID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerID="67d92e39ae04201d23980251f4835089a0b657219cab8c2f034473aa569a4225" exitCode=0 Jun 02 15:37:06.777005 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:06.776695 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" event={"ID":"0a917319-23cc-4f5c-abcf-3e45c2fcb73f","Type":"ContainerDied","Data":"67d92e39ae04201d23980251f4835089a0b657219cab8c2f034473aa569a4225"} Jun 02 15:37:07.917586 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:07.917552 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:08.062451 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.062372 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfr2f\" (UniqueName: \"kubernetes.io/projected/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-kube-api-access-nfr2f\") pod \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " Jun 02 15:37:08.062451 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.062414 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-util\") pod \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " Jun 02 15:37:08.062689 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.062541 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-bundle\") pod \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\" (UID: \"0a917319-23cc-4f5c-abcf-3e45c2fcb73f\") " Jun 02 15:37:08.063133 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.063051 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-bundle" (OuterVolumeSpecName: "bundle") pod "0a917319-23cc-4f5c-abcf-3e45c2fcb73f" (UID: "0a917319-23cc-4f5c-abcf-3e45c2fcb73f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:37:08.064671 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.064638 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-kube-api-access-nfr2f" (OuterVolumeSpecName: "kube-api-access-nfr2f") pod "0a917319-23cc-4f5c-abcf-3e45c2fcb73f" (UID: "0a917319-23cc-4f5c-abcf-3e45c2fcb73f"). InnerVolumeSpecName "kube-api-access-nfr2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:37:08.070620 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.070597 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-util" (OuterVolumeSpecName: "util") pod "0a917319-23cc-4f5c-abcf-3e45c2fcb73f" (UID: "0a917319-23cc-4f5c-abcf-3e45c2fcb73f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:37:08.163899 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.163862 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfr2f\" (UniqueName: \"kubernetes.io/projected/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-kube-api-access-nfr2f\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:37:08.163899 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.163896 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-util\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:37:08.164092 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.163912 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a917319-23cc-4f5c-abcf-3e45c2fcb73f-bundle\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:37:08.785362 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.785322 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" event={"ID":"0a917319-23cc-4f5c-abcf-3e45c2fcb73f","Type":"ContainerDied","Data":"034cdd280bd057dc6e17c8977abe361875b4d85c496818ac040556a298cba8aa"} Jun 02 15:37:08.785566 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.785369 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="034cdd280bd057dc6e17c8977abe361875b4d85c496818ac040556a298cba8aa" Jun 02 15:37:08.785566 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:08.785340 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70cf7vp" Jun 02 15:37:29.420703 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.420665 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:37:29.421084 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421057 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="pull" Jun 02 15:37:29.421084 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421068 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="pull" Jun 02 15:37:29.421084 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421083 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="util" Jun 02 15:37:29.421187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421090 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="util" Jun 02 15:37:29.421187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421097 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="extract" Jun 02 15:37:29.421187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421103 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="extract" Jun 02 15:37:29.421187 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.421161 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a917319-23cc-4f5c-abcf-3e45c2fcb73f" containerName="extract" Jun 02 15:37:29.423675 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.423656 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:29.426861 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.426843 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v7wrr\"" Jun 02 15:37:29.426966 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.426871 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 15:37:29.427881 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.427856 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 15:37:29.427988 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.427964 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 15:37:29.441771 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.441748 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:37:29.539370 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.539332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djqrn\" (UniqueName: \"kubernetes.io/projected/48600305-275a-4382-b195-7dfbc4cca55a-kube-api-access-djqrn\") pod \"maas-keycloak-0\" (UID: \"48600305-275a-4382-b195-7dfbc4cca55a\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:29.640073 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.640045 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djqrn\" (UniqueName: \"kubernetes.io/projected/48600305-275a-4382-b195-7dfbc4cca55a-kube-api-access-djqrn\") pod \"maas-keycloak-0\" (UID: \"48600305-275a-4382-b195-7dfbc4cca55a\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:29.651037 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.651014 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djqrn\" (UniqueName: \"kubernetes.io/projected/48600305-275a-4382-b195-7dfbc4cca55a-kube-api-access-djqrn\") pod \"maas-keycloak-0\" (UID: \"48600305-275a-4382-b195-7dfbc4cca55a\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:29.733194 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.733111 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:29.888246 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:29.888202 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:37:29.892878 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:37:29.892848 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48600305_275a_4382_b195_7dfbc4cca55a.slice/crio-9c13117ac1662e1d612d2a5744d3d14b97e344e57f0774db4eb82bf05a73096d WatchSource:0}: Error finding container 9c13117ac1662e1d612d2a5744d3d14b97e344e57f0774db4eb82bf05a73096d: Status 404 returned error can't find the container with id 9c13117ac1662e1d612d2a5744d3d14b97e344e57f0774db4eb82bf05a73096d Jun 02 15:37:30.871276 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:30.871236 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"48600305-275a-4382-b195-7dfbc4cca55a","Type":"ContainerStarted","Data":"9c13117ac1662e1d612d2a5744d3d14b97e344e57f0774db4eb82bf05a73096d"} Jun 02 15:37:35.897197 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:35.897149 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"48600305-275a-4382-b195-7dfbc4cca55a","Type":"ContainerStarted","Data":"96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c"} Jun 02 15:37:35.924133 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:35.924088 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5828763559999999 podStartE2EDuration="6.924075087s" podCreationTimestamp="2026-06-02 15:37:29 +0000 UTC" firstStartedPulling="2026-06-02 15:37:29.894167384 +0000 UTC m=+816.499860056" lastFinishedPulling="2026-06-02 15:37:35.235366115 +0000 UTC m=+821.841058787" observedRunningTime="2026-06-02 15:37:35.921031687 +0000 UTC m=+822.526724380" watchObservedRunningTime="2026-06-02 15:37:35.924075087 +0000 UTC m=+822.529767780" Jun 02 15:37:36.733930 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:36.733884 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:36.735433 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:36.735400 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:37.733686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:37.733634 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:38.734549 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:38.734483 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:39.733947 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:39.733902 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:39.734360 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:39.734317 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:40.734482 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:40.734425 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:41.734165 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:41.734109 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:42.733633 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:42.733565 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:43.734520 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:43.734466 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:44.734102 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:44.734043 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:45.733851 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:45.733802 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:46.734341 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:46.734287 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:47.734326 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:47.734275 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 02 15:37:48.863909 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:48.863865 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 15:37:48.882877 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:48.882818 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:37:58.870882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:37:58.870843 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:05.498037 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.498000 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67f5f7446-hwqpq"] Jun 02 15:38:05.506118 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.506094 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:05.509825 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.509796 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 15:38:05.509989 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.509796 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p56z9\"" Jun 02 15:38:05.512217 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.512191 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67f5f7446-hwqpq"] Jun 02 15:38:05.578546 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.578515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grb8x\" (UniqueName: \"kubernetes.io/projected/f10d2efa-b28d-478b-b685-c0a911980584-kube-api-access-grb8x\") pod \"maas-controller-67f5f7446-hwqpq\" (UID: \"f10d2efa-b28d-478b-b685-c0a911980584\") " pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:05.671250 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.671216 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-594d58948c-lrzrx"] Jun 02 15:38:05.673852 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.673836 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:05.679153 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.679124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rpzq\" (UniqueName: \"kubernetes.io/projected/49a3af9b-b721-4840-b2fc-a0e9a7f61bda-kube-api-access-2rpzq\") pod \"maas-controller-594d58948c-lrzrx\" (UID: \"49a3af9b-b721-4840-b2fc-a0e9a7f61bda\") " pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:05.679299 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.679274 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grb8x\" (UniqueName: \"kubernetes.io/projected/f10d2efa-b28d-478b-b685-c0a911980584-kube-api-access-grb8x\") pod \"maas-controller-67f5f7446-hwqpq\" (UID: \"f10d2efa-b28d-478b-b685-c0a911980584\") " pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:05.685131 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.685109 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-594d58948c-lrzrx"] Jun 02 15:38:05.691487 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.691456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grb8x\" (UniqueName: \"kubernetes.io/projected/f10d2efa-b28d-478b-b685-c0a911980584-kube-api-access-grb8x\") pod \"maas-controller-67f5f7446-hwqpq\" (UID: \"f10d2efa-b28d-478b-b685-c0a911980584\") " pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:05.780014 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.779933 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rpzq\" (UniqueName: \"kubernetes.io/projected/49a3af9b-b721-4840-b2fc-a0e9a7f61bda-kube-api-access-2rpzq\") pod \"maas-controller-594d58948c-lrzrx\" (UID: \"49a3af9b-b721-4840-b2fc-a0e9a7f61bda\") " pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:05.790544 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.790517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rpzq\" (UniqueName: \"kubernetes.io/projected/49a3af9b-b721-4840-b2fc-a0e9a7f61bda-kube-api-access-2rpzq\") pod \"maas-controller-594d58948c-lrzrx\" (UID: \"49a3af9b-b721-4840-b2fc-a0e9a7f61bda\") " pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:05.818515 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.818488 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:05.982318 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.982289 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67f5f7446-hwqpq"] Jun 02 15:38:05.982462 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:38:05.982292 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10d2efa_b28d_478b_b685_c0a911980584.slice/crio-c11656b00b7d3e40304df446505131f460879af2de8fc035f15b9b8922757697 WatchSource:0}: Error finding container c11656b00b7d3e40304df446505131f460879af2de8fc035f15b9b8922757697: Status 404 returned error can't find the container with id c11656b00b7d3e40304df446505131f460879af2de8fc035f15b9b8922757697 Jun 02 15:38:05.985235 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:05.985216 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:06.054623 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:06.054558 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67f5f7446-hwqpq" event={"ID":"f10d2efa-b28d-478b-b685-c0a911980584","Type":"ContainerStarted","Data":"c11656b00b7d3e40304df446505131f460879af2de8fc035f15b9b8922757697"} Jun 02 15:38:06.163629 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:38:06.163591 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a3af9b_b721_4840_b2fc_a0e9a7f61bda.slice/crio-a17e396f052188ded8879c382207d53ed7d3c3746450d6b3256f4aec7465aca2 WatchSource:0}: Error finding container a17e396f052188ded8879c382207d53ed7d3c3746450d6b3256f4aec7465aca2: Status 404 returned error can't find the container with id a17e396f052188ded8879c382207d53ed7d3c3746450d6b3256f4aec7465aca2 Jun 02 15:38:06.166461 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:06.166435 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-594d58948c-lrzrx"] Jun 02 15:38:07.062808 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:07.062764 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-594d58948c-lrzrx" event={"ID":"49a3af9b-b721-4840-b2fc-a0e9a7f61bda","Type":"ContainerStarted","Data":"a17e396f052188ded8879c382207d53ed7d3c3746450d6b3256f4aec7465aca2"} Jun 02 15:38:09.071682 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:09.071637 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67f5f7446-hwqpq" event={"ID":"f10d2efa-b28d-478b-b685-c0a911980584","Type":"ContainerStarted","Data":"76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0"} Jun 02 15:38:09.072164 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:09.071768 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:09.073063 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:09.073036 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-594d58948c-lrzrx" event={"ID":"49a3af9b-b721-4840-b2fc-a0e9a7f61bda","Type":"ContainerStarted","Data":"c7c17eda6449d4175259af97e8af6ded83a2bbb412eb8b15ab98ca50974704bd"} Jun 02 15:38:09.073205 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:09.073190 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:09.118296 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:09.118236 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-67f5f7446-hwqpq" podStartSLOduration=1.5316927219999998 podStartE2EDuration="4.118222186s" podCreationTimestamp="2026-06-02 15:38:05 +0000 UTC" firstStartedPulling="2026-06-02 15:38:05.983874632 +0000 UTC m=+852.589567304" lastFinishedPulling="2026-06-02 15:38:08.570404085 +0000 UTC m=+855.176096768" observedRunningTime="2026-06-02 15:38:09.114757702 +0000 UTC m=+855.720450408" watchObservedRunningTime="2026-06-02 15:38:09.118222186 +0000 UTC m=+855.723914879" Jun 02 15:38:09.163611 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:09.163542 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-594d58948c-lrzrx" podStartSLOduration=1.747896554 podStartE2EDuration="4.163528731s" podCreationTimestamp="2026-06-02 15:38:05 +0000 UTC" firstStartedPulling="2026-06-02 15:38:06.165474533 +0000 UTC m=+852.771167206" lastFinishedPulling="2026-06-02 15:38:08.581106709 +0000 UTC m=+855.186799383" observedRunningTime="2026-06-02 15:38:09.161732334 +0000 UTC m=+855.767425028" watchObservedRunningTime="2026-06-02 15:38:09.163528731 +0000 UTC m=+855.769221424" Jun 02 15:38:20.083024 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.082991 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:20.083397 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.083045 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-594d58948c-lrzrx" Jun 02 15:38:20.169692 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.169666 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67f5f7446-hwqpq"] Jun 02 15:38:20.169912 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.169891 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-67f5f7446-hwqpq" podUID="f10d2efa-b28d-478b-b685-c0a911980584" containerName="manager" containerID="cri-o://76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0" gracePeriod=30 Jun 02 15:38:20.412042 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.412013 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:20.510107 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.510069 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grb8x\" (UniqueName: \"kubernetes.io/projected/f10d2efa-b28d-478b-b685-c0a911980584-kube-api-access-grb8x\") pod \"f10d2efa-b28d-478b-b685-c0a911980584\" (UID: \"f10d2efa-b28d-478b-b685-c0a911980584\") " Jun 02 15:38:20.512377 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.512352 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10d2efa-b28d-478b-b685-c0a911980584-kube-api-access-grb8x" (OuterVolumeSpecName: "kube-api-access-grb8x") pod "f10d2efa-b28d-478b-b685-c0a911980584" (UID: "f10d2efa-b28d-478b-b685-c0a911980584"). InnerVolumeSpecName "kube-api-access-grb8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:38:20.611045 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:20.610997 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grb8x\" (UniqueName: \"kubernetes.io/projected/f10d2efa-b28d-478b-b685-c0a911980584-kube-api-access-grb8x\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:38:21.122786 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.122750 2579 generic.go:358] "Generic (PLEG): container finished" podID="f10d2efa-b28d-478b-b685-c0a911980584" containerID="76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0" exitCode=0 Jun 02 15:38:21.123209 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.122809 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67f5f7446-hwqpq" Jun 02 15:38:21.123209 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.122828 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67f5f7446-hwqpq" event={"ID":"f10d2efa-b28d-478b-b685-c0a911980584","Type":"ContainerDied","Data":"76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0"} Jun 02 15:38:21.123209 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.122867 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67f5f7446-hwqpq" event={"ID":"f10d2efa-b28d-478b-b685-c0a911980584","Type":"ContainerDied","Data":"c11656b00b7d3e40304df446505131f460879af2de8fc035f15b9b8922757697"} Jun 02 15:38:21.123209 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.122882 2579 scope.go:117] "RemoveContainer" containerID="76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0" Jun 02 15:38:21.132462 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.132447 2579 scope.go:117] "RemoveContainer" containerID="76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0" Jun 02 15:38:21.132726 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:38:21.132706 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0\": container with ID starting with 76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0 not found: ID does not exist" containerID="76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0" Jun 02 15:38:21.132791 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.132734 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0"} err="failed to get container status \"76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0\": rpc error: code = NotFound desc = could not find container \"76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0\": container with ID starting with 76ad9e308e16987587ca2a5a32537411cd79b57bab35057ac27eac01d2d7e4c0 not found: ID does not exist" Jun 02 15:38:21.147877 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.147854 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67f5f7446-hwqpq"] Jun 02 15:38:21.151847 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:21.151827 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67f5f7446-hwqpq"] Jun 02 15:38:22.038217 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:22.038182 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f10d2efa-b28d-478b-b685-c0a911980584" path="/var/lib/kubelet/pods/f10d2efa-b28d-478b-b685-c0a911980584/volumes" Jun 02 15:38:38.671480 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.671441 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d9b6489bc-fvxr9"] Jun 02 15:38:38.671976 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.671874 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10d2efa-b28d-478b-b685-c0a911980584" containerName="manager" Jun 02 15:38:38.671976 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.671888 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10d2efa-b28d-478b-b685-c0a911980584" containerName="manager" Jun 02 15:38:38.671976 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.671972 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="f10d2efa-b28d-478b-b685-c0a911980584" containerName="manager" Jun 02 15:38:38.674804 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.674787 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:38.677645 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.677622 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 15:38:38.677873 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.677861 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fphdx\"" Jun 02 15:38:38.690114 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.690085 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d9b6489bc-fvxr9"] Jun 02 15:38:38.768086 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.768058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94889b4e-7583-4e79-8d1e-446b3835aaab-maas-api-tls\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:38.768214 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.768187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rk8\" (UniqueName: \"kubernetes.io/projected/94889b4e-7583-4e79-8d1e-446b3835aaab-kube-api-access-n4rk8\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:38.868790 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.868757 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94889b4e-7583-4e79-8d1e-446b3835aaab-maas-api-tls\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:38.868994 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.868879 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rk8\" (UniqueName: \"kubernetes.io/projected/94889b4e-7583-4e79-8d1e-446b3835aaab-kube-api-access-n4rk8\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:38.868994 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:38:38.868937 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 02 15:38:38.869096 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:38:38.869030 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94889b4e-7583-4e79-8d1e-446b3835aaab-maas-api-tls podName:94889b4e-7583-4e79-8d1e-446b3835aaab nodeName:}" failed. No retries permitted until 2026-06-02 15:38:39.369009338 +0000 UTC m=+885.974702027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94889b4e-7583-4e79-8d1e-446b3835aaab-maas-api-tls") pod "maas-api-5d9b6489bc-fvxr9" (UID: "94889b4e-7583-4e79-8d1e-446b3835aaab") : secret "maas-api-serving-cert" not found Jun 02 15:38:38.879637 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:38.879607 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rk8\" (UniqueName: \"kubernetes.io/projected/94889b4e-7583-4e79-8d1e-446b3835aaab-kube-api-access-n4rk8\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:39.372964 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:39.372928 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94889b4e-7583-4e79-8d1e-446b3835aaab-maas-api-tls\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:39.375445 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:39.375422 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94889b4e-7583-4e79-8d1e-446b3835aaab-maas-api-tls\") pod \"maas-api-5d9b6489bc-fvxr9\" (UID: \"94889b4e-7583-4e79-8d1e-446b3835aaab\") " pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:39.610754 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:39.610715 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:39.765135 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:39.765107 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d9b6489bc-fvxr9"] Jun 02 15:38:39.766753 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:38:39.766717 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94889b4e_7583_4e79_8d1e_446b3835aaab.slice/crio-7164c4aeb6296aac8c863f0df159d837eceb5645d83152536cbad453a613274b WatchSource:0}: Error finding container 7164c4aeb6296aac8c863f0df159d837eceb5645d83152536cbad453a613274b: Status 404 returned error can't find the container with id 7164c4aeb6296aac8c863f0df159d837eceb5645d83152536cbad453a613274b Jun 02 15:38:40.204546 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:40.204508 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" event={"ID":"94889b4e-7583-4e79-8d1e-446b3835aaab","Type":"ContainerStarted","Data":"7164c4aeb6296aac8c863f0df159d837eceb5645d83152536cbad453a613274b"} Jun 02 15:38:42.214554 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:42.214518 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" event={"ID":"94889b4e-7583-4e79-8d1e-446b3835aaab","Type":"ContainerStarted","Data":"5de9578e51f514dd05336bb7340a2e2210e75c1fce452b1107a5246cd80b95bd"} Jun 02 15:38:42.215048 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:42.214623 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:42.235396 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:42.235348 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" podStartSLOduration=2.549320921 podStartE2EDuration="4.235335136s" podCreationTimestamp="2026-06-02 15:38:38 +0000 UTC" firstStartedPulling="2026-06-02 15:38:39.768099502 +0000 UTC m=+886.373792186" lastFinishedPulling="2026-06-02 15:38:41.454113729 +0000 UTC m=+888.059806401" observedRunningTime="2026-06-02 15:38:42.233060593 +0000 UTC m=+888.838753286" watchObservedRunningTime="2026-06-02 15:38:42.235335136 +0000 UTC m=+888.841027830" Jun 02 15:38:48.223938 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:48.223905 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d9b6489bc-fvxr9" Jun 02 15:38:50.081725 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:50.081691 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:38:50.082219 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:50.081907 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" containerID="cri-o://96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c" gracePeriod=30 Jun 02 15:38:52.130418 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.130389 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.192068 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.192027 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djqrn\" (UniqueName: \"kubernetes.io/projected/48600305-275a-4382-b195-7dfbc4cca55a-kube-api-access-djqrn\") pod \"48600305-275a-4382-b195-7dfbc4cca55a\" (UID: \"48600305-275a-4382-b195-7dfbc4cca55a\") " Jun 02 15:38:52.194314 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.194291 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48600305-275a-4382-b195-7dfbc4cca55a-kube-api-access-djqrn" (OuterVolumeSpecName: "kube-api-access-djqrn") pod "48600305-275a-4382-b195-7dfbc4cca55a" (UID: "48600305-275a-4382-b195-7dfbc4cca55a"). InnerVolumeSpecName "kube-api-access-djqrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:38:52.258986 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.258887 2579 generic.go:358] "Generic (PLEG): container finished" podID="48600305-275a-4382-b195-7dfbc4cca55a" containerID="96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c" exitCode=143 Jun 02 15:38:52.258986 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.258961 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.258986 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.258975 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"48600305-275a-4382-b195-7dfbc4cca55a","Type":"ContainerDied","Data":"96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c"} Jun 02 15:38:52.259249 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.259019 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"48600305-275a-4382-b195-7dfbc4cca55a","Type":"ContainerDied","Data":"9c13117ac1662e1d612d2a5744d3d14b97e344e57f0774db4eb82bf05a73096d"} Jun 02 15:38:52.259249 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.259037 2579 scope.go:117] "RemoveContainer" containerID="96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c" Jun 02 15:38:52.269628 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.269611 2579 scope.go:117] "RemoveContainer" containerID="96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c" Jun 02 15:38:52.269880 ip-10-0-141-151 kubenswrapper[2579]: E0602 15:38:52.269861 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c\": container with ID starting with 96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c not found: ID does not exist" containerID="96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c" Jun 02 15:38:52.269927 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.269890 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c"} err="failed to get container status \"96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c\": rpc error: code = NotFound desc = could not find container \"96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c\": container with ID starting with 96f619c9287da8be9e62416601351ac74d1ac67bcde70db7471659887865b42c not found: ID does not exist" Jun 02 15:38:52.284351 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.284323 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:38:52.288537 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.288518 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:38:52.293398 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.293374 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djqrn\" (UniqueName: \"kubernetes.io/projected/48600305-275a-4382-b195-7dfbc4cca55a-kube-api-access-djqrn\") on node \"ip-10-0-141-151.ec2.internal\" DevicePath \"\"" Jun 02 15:38:52.316340 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.316320 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:38:52.316757 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.316716 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" Jun 02 15:38:52.316757 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.316737 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" Jun 02 15:38:52.316897 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.316842 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="48600305-275a-4382-b195-7dfbc4cca55a" containerName="keycloak" Jun 02 15:38:52.319857 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.319842 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.322757 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.322732 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 15:38:52.322933 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.322757 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 15:38:52.322933 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.322742 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 15:38:52.322933 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.322781 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 15:38:52.322933 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.322825 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v7wrr\"" Jun 02 15:38:52.330387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.330370 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:38:52.394071 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.394038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggkz\" (UniqueName: \"kubernetes.io/projected/00fb7290-d084-4b3d-b752-f810bf557d4e-kube-api-access-vggkz\") pod \"maas-keycloak-0\" (UID: \"00fb7290-d084-4b3d-b752-f810bf557d4e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.394220 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.394100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/00fb7290-d084-4b3d-b752-f810bf557d4e-test-realms\") pod \"maas-keycloak-0\" (UID: \"00fb7290-d084-4b3d-b752-f810bf557d4e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.494939 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.494901 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/00fb7290-d084-4b3d-b752-f810bf557d4e-test-realms\") pod \"maas-keycloak-0\" (UID: \"00fb7290-d084-4b3d-b752-f810bf557d4e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.495092 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.494997 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vggkz\" (UniqueName: \"kubernetes.io/projected/00fb7290-d084-4b3d-b752-f810bf557d4e-kube-api-access-vggkz\") pod \"maas-keycloak-0\" (UID: \"00fb7290-d084-4b3d-b752-f810bf557d4e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.495664 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.495645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/00fb7290-d084-4b3d-b752-f810bf557d4e-test-realms\") pod \"maas-keycloak-0\" (UID: \"00fb7290-d084-4b3d-b752-f810bf557d4e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.504919 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.504892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggkz\" (UniqueName: \"kubernetes.io/projected/00fb7290-d084-4b3d-b752-f810bf557d4e-kube-api-access-vggkz\") pod \"maas-keycloak-0\" (UID: \"00fb7290-d084-4b3d-b752-f810bf557d4e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.631201 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.631174 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:52.768459 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:52.768436 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 15:38:52.769615 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:38:52.769591 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fb7290_d084_4b3d_b752_f810bf557d4e.slice/crio-a040d0e553654df69bb8c1e97bf716b23d7d1e2852415cfe3f37e6c99f334eee WatchSource:0}: Error finding container a040d0e553654df69bb8c1e97bf716b23d7d1e2852415cfe3f37e6c99f334eee: Status 404 returned error can't find the container with id a040d0e553654df69bb8c1e97bf716b23d7d1e2852415cfe3f37e6c99f334eee Jun 02 15:38:53.265259 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.265233 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"00fb7290-d084-4b3d-b752-f810bf557d4e","Type":"ContainerStarted","Data":"e6377e586eabe9721bf225457a2b9d0c924c29709f0df387d7306bb278df1098"} Jun 02 15:38:53.265562 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.265265 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"00fb7290-d084-4b3d-b752-f810bf557d4e","Type":"ContainerStarted","Data":"a040d0e553654df69bb8c1e97bf716b23d7d1e2852415cfe3f37e6c99f334eee"} Jun 02 15:38:53.295540 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.295491 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.875387239 podStartE2EDuration="1.295476573s" podCreationTimestamp="2026-06-02 15:38:52 +0000 UTC" firstStartedPulling="2026-06-02 15:38:52.77079259 +0000 UTC m=+899.376485265" lastFinishedPulling="2026-06-02 15:38:53.190881925 +0000 UTC m=+899.796574599" observedRunningTime="2026-06-02 15:38:53.293686099 +0000 UTC m=+899.899378805" watchObservedRunningTime="2026-06-02 15:38:53.295476573 +0000 UTC m=+899.901169266" Jun 02 15:38:53.631634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.631565 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 15:38:53.633357 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.633323 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:38:53.981483 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.981450 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:38:53.983870 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:53.983850 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:38:54.033712 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:54.033675 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48600305-275a-4382-b195-7dfbc4cca55a" path="/var/lib/kubelet/pods/48600305-275a-4382-b195-7dfbc4cca55a/volumes" Jun 02 15:38:54.632075 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:54.632024 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:38:55.632139 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:55.632085 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:38:56.632120 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:56.632067 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:38:57.632598 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:57.632523 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:38:58.632783 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:58.632719 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:38:59.632524 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:38:59.632470 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:00.631976 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:00.631928 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:01.632595 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:01.632532 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:02.631669 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:02.631624 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:39:02.632247 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:02.632211 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:03.632583 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:03.632528 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:04.632027 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:04.631983 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:05.632055 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:05.632006 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.52:9000/health/started\": dial tcp 10.134.0.52:9000: connect: connection refused" Jun 02 15:39:06.757133 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:06.757091 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 15:39:06.775978 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:06.775918 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="00fb7290-d084-4b3d-b752-f810bf557d4e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 15:39:16.763017 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:16.762978 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 15:39:38.848505 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.848471 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85"] Jun 02 15:39:38.852603 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.852584 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:38.862156 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.862133 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 15:39:38.862254 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.862140 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 15:39:38.862314 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.862141 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-px7g7\"" Jun 02 15:39:38.862314 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.862140 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 15:39:38.873390 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.873368 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85"] Jun 02 15:39:38.934715 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.934691 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:38.934860 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.934737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7ed676-0cb1-49f6-8072-925509a980ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:38.934860 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.934768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfl8m\" (UniqueName: \"kubernetes.io/projected/6e7ed676-0cb1-49f6-8072-925509a980ec-kube-api-access-qfl8m\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:38.934860 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.934795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:38.935007 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.934884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:38.935007 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:38.934915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.035772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.035740 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.035908 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.035780 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.035908 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.035821 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.035908 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.035845 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7ed676-0cb1-49f6-8072-925509a980ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.035908 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.035862 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfl8m\" (UniqueName: \"kubernetes.io/projected/6e7ed676-0cb1-49f6-8072-925509a980ec-kube-api-access-qfl8m\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.035908 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.035879 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.036202 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.036177 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.036258 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.036218 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.036258 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.036243 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.038220 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.038201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e7ed676-0cb1-49f6-8072-925509a980ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.038490 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.038471 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7ed676-0cb1-49f6-8072-925509a980ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.050142 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.050119 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfl8m\" (UniqueName: \"kubernetes.io/projected/6e7ed676-0cb1-49f6-8072-925509a980ec-kube-api-access-qfl8m\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85\" (UID: \"6e7ed676-0cb1-49f6-8072-925509a980ec\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.163370 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.163300 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:39.317669 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.317629 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85"] Jun 02 15:39:39.487454 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:39.487373 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" event={"ID":"6e7ed676-0cb1-49f6-8072-925509a980ec","Type":"ContainerStarted","Data":"0107b8cc47ebac3741823cced4f5de74944398db5bd590b4d71cce7bc192f7b0"} Jun 02 15:39:44.509143 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:44.509103 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" event={"ID":"6e7ed676-0cb1-49f6-8072-925509a980ec","Type":"ContainerStarted","Data":"e8e13b982bd92f03c629760180f302d5ad45375c092dcef19d1e67126f1d04c5"} Jun 02 15:39:45.515026 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:45.514921 2579 generic.go:358] "Generic (PLEG): container finished" podID="6e7ed676-0cb1-49f6-8072-925509a980ec" containerID="e8e13b982bd92f03c629760180f302d5ad45375c092dcef19d1e67126f1d04c5" exitCode=0 Jun 02 15:39:45.515026 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:45.514992 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" event={"ID":"6e7ed676-0cb1-49f6-8072-925509a980ec","Type":"ContainerDied","Data":"e8e13b982bd92f03c629760180f302d5ad45375c092dcef19d1e67126f1d04c5"} Jun 02 15:39:48.530115 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:48.530079 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" event={"ID":"6e7ed676-0cb1-49f6-8072-925509a980ec","Type":"ContainerStarted","Data":"35dc3c31a0eaa15ef269d86ba451067a9ac66056d9a9611e5e2a9a6058989e37"} Jun 02 15:39:48.556065 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:48.556019 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" podStartSLOduration=2.411379432 podStartE2EDuration="10.556005231s" podCreationTimestamp="2026-06-02 15:39:38 +0000 UTC" firstStartedPulling="2026-06-02 15:39:39.320456117 +0000 UTC m=+945.926148793" lastFinishedPulling="2026-06-02 15:39:47.465081919 +0000 UTC m=+954.070774592" observedRunningTime="2026-06-02 15:39:48.553192043 +0000 UTC m=+955.158884737" watchObservedRunningTime="2026-06-02 15:39:48.556005231 +0000 UTC m=+955.161697951" Jun 02 15:39:49.164216 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:49.164174 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:49.164216 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:49.164214 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:49.176804 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:49.176776 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:39:49.544998 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:39:49.544911 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85" Jun 02 15:40:47.500403 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.500372 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr"] Jun 02 15:40:47.503329 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.503302 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.508094 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.508072 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 15:40:47.520132 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.520106 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr"] Jun 02 15:40:47.652432 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.652392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.652634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.652438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.652634 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.652506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdpqx\" (UniqueName: \"kubernetes.io/projected/290b6f60-0668-462c-adac-0a9c2b29b2d2-kube-api-access-sdpqx\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.652720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.652647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290b6f60-0668-462c-adac-0a9c2b29b2d2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.652720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.652678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.652720 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.652694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753167 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290b6f60-0668-462c-adac-0a9c2b29b2d2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753215 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753257 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753234 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753514 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753270 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753514 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753292 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753514 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753325 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdpqx\" (UniqueName: \"kubernetes.io/projected/290b6f60-0668-462c-adac-0a9c2b29b2d2-kube-api-access-sdpqx\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753794 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753928 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753816 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.753928 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.753853 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.755839 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.755817 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290b6f60-0668-462c-adac-0a9c2b29b2d2-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.755968 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.755949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290b6f60-0668-462c-adac-0a9c2b29b2d2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.763671 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.763641 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdpqx\" (UniqueName: \"kubernetes.io/projected/290b6f60-0668-462c-adac-0a9c2b29b2d2-kube-api-access-sdpqx\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr\" (UID: \"290b6f60-0668-462c-adac-0a9c2b29b2d2\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.814162 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.814129 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" Jun 02 15:40:47.955082 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.954843 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr"] Jun 02 15:40:47.955229 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:40:47.955103 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290b6f60_0668_462c_adac_0a9c2b29b2d2.slice/crio-327f9dbe173e121b647c0ec5b0bc9ae9cd797e5aa439532cbd27ef8b560c0f55 WatchSource:0}: Error finding container 327f9dbe173e121b647c0ec5b0bc9ae9cd797e5aa439532cbd27ef8b560c0f55: Status 404 returned error can't find the container with id 327f9dbe173e121b647c0ec5b0bc9ae9cd797e5aa439532cbd27ef8b560c0f55 Jun 02 15:40:47.957011 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:47.956992 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:40:48.783677 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:48.783638 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" event={"ID":"290b6f60-0668-462c-adac-0a9c2b29b2d2","Type":"ContainerStarted","Data":"103e99b5e755c6ce25673f7cc755ca2a0eeb23350aaa076959875f11493d0e49"} Jun 02 15:40:48.783677 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:40:48.783678 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr" event={"ID":"290b6f60-0668-462c-adac-0a9c2b29b2d2","Type":"ContainerStarted","Data":"327f9dbe173e121b647c0ec5b0bc9ae9cd797e5aa439532cbd27ef8b560c0f55"} Jun 02 15:43:54.026273 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:43:54.026239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:43:54.031380 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:43:54.031353 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:46:31.205380 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:31.205346 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr_290b6f60-0668-462c-adac-0a9c2b29b2d2/storage-initializer/0.log" Jun 02 15:46:37.787587 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:37.787537 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d9b6489bc-fvxr9_94889b4e-7583-4e79-8d1e-446b3835aaab/maas-api/0.log" Jun 02 15:46:38.033175 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:38.033145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-594d58948c-lrzrx_49a3af9b-b721-4840-b2fc-a0e9a7f61bda/manager/0.log" Jun 02 15:46:38.671772 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:38.671747 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99_cd120c42-6313-4216-adb6-c9a1c0c97dfd/copy-manifests/0.log" Jun 02 15:46:38.692376 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:38.692350 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99_cd120c42-6313-4216-adb6-c9a1c0c97dfd/manager/0.log" Jun 02 15:46:39.717836 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.717806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn_d9825baa-1676-4701-a54d-14c9a7ea7a0b/util/0.log" Jun 02 15:46:39.725222 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.725201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn_d9825baa-1676-4701-a54d-14c9a7ea7a0b/pull/0.log" Jun 02 15:46:39.732068 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.732044 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn_d9825baa-1676-4701-a54d-14c9a7ea7a0b/extract/0.log" Jun 02 15:46:39.853069 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.853040 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb_a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3/util/0.log" Jun 02 15:46:39.860155 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.860132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb_a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3/pull/0.log" Jun 02 15:46:39.867148 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.867131 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb_a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3/extract/0.log" Jun 02 15:46:39.984103 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.984029 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp_e5a7cb61-bf89-4af5-9e50-8ab60cb70290/pull/0.log" Jun 02 15:46:39.991537 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.991515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp_e5a7cb61-bf89-4af5-9e50-8ab60cb70290/extract/0.log" Jun 02 15:46:39.997938 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:39.997913 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp_e5a7cb61-bf89-4af5-9e50-8ab60cb70290/util/0.log" Jun 02 15:46:40.122367 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:40.122335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs_5040654a-eccf-45f8-80c0-b2006b22aa95/pull/0.log" Jun 02 15:46:40.128953 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:40.128927 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs_5040654a-eccf-45f8-80c0-b2006b22aa95/extract/0.log" Jun 02 15:46:40.135309 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:40.135290 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs_5040654a-eccf-45f8-80c0-b2006b22aa95/util/0.log" Jun 02 15:46:40.496549 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:40.496514 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-x2zzw_e282b26a-e63a-4381-9534-9e78cabf2cad/manager/0.log" Jun 02 15:46:40.616651 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:40.616622 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-rn89w_de628d92-bfdc-490f-a4ee-0fb7a0b54f51/kuadrant-console-plugin/0.log" Jun 02 15:46:40.882209 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:40.882169 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-jcrjs_3d4bfaa1-afae-4c23-bb83-0d1dba036cfe/manager/0.log" Jun 02 15:46:41.877793 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:41.877760 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bcfb9d8b-7xckk_b2433887-4d33-4c10-b5bf-2ad46c9b3a72/kube-auth-proxy/0.log" Jun 02 15:46:42.592165 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:42.592133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85_6e7ed676-0cb1-49f6-8072-925509a980ec/storage-initializer/0.log" Jun 02 15:46:42.605319 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:42.605291 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-kqv85_6e7ed676-0cb1-49f6-8072-925509a980ec/main/0.log" Jun 02 15:46:43.245922 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:43.245893 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-vmrxr_290b6f60-0668-462c-adac-0a9c2b29b2d2/storage-initializer/0.log" Jun 02 15:46:50.141298 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:50.141270 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s7x2k_a91aa4f2-5920-44dd-bf1e-208254b734b4/global-pull-secret-syncer/0.log" Jun 02 15:46:50.245690 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:50.245662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gnms9_47e08586-830a-4ff9-bb79-0492deb6c46c/konnectivity-agent/0.log" Jun 02 15:46:50.412644 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:50.412553 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-151.ec2.internal_8c2fdabb8b5f7451ee10e0409d68ce8b/haproxy/0.log" Jun 02 15:46:54.205795 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.205757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn_d9825baa-1676-4701-a54d-14c9a7ea7a0b/extract/0.log" Jun 02 15:46:54.228633 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.228609 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn_d9825baa-1676-4701-a54d-14c9a7ea7a0b/util/0.log" Jun 02 15:46:54.261625 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.261587 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759b26dn_d9825baa-1676-4701-a54d-14c9a7ea7a0b/pull/0.log" Jun 02 15:46:54.289362 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.289341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb_a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3/extract/0.log" Jun 02 15:46:54.313097 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.313069 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb_a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3/util/0.log" Jun 02 15:46:54.343441 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.343415 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzbdb_a5e6d6b7-53dc-4f31-852b-2a5ec2fa87e3/pull/0.log" Jun 02 15:46:54.372960 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.372931 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp_e5a7cb61-bf89-4af5-9e50-8ab60cb70290/extract/0.log" Jun 02 15:46:54.403333 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.403311 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp_e5a7cb61-bf89-4af5-9e50-8ab60cb70290/util/0.log" Jun 02 15:46:54.436681 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.436663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c87cp_e5a7cb61-bf89-4af5-9e50-8ab60cb70290/pull/0.log" Jun 02 15:46:54.499686 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.499599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs_5040654a-eccf-45f8-80c0-b2006b22aa95/extract/0.log" Jun 02 15:46:54.565424 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.565393 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs_5040654a-eccf-45f8-80c0-b2006b22aa95/util/0.log" Jun 02 15:46:54.597144 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.597114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1plgqs_5040654a-eccf-45f8-80c0-b2006b22aa95/pull/0.log" Jun 02 15:46:54.686241 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.686214 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-x2zzw_e282b26a-e63a-4381-9534-9e78cabf2cad/manager/0.log" Jun 02 15:46:54.725298 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.725273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-rn89w_de628d92-bfdc-490f-a4ee-0fb7a0b54f51/kuadrant-console-plugin/0.log" Jun 02 15:46:54.801456 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:54.801368 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-jcrjs_3d4bfaa1-afae-4c23-bb83-0d1dba036cfe/manager/0.log" Jun 02 15:46:56.364629 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.364601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/alertmanager/0.log" Jun 02 15:46:56.397023 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.396992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/config-reloader/0.log" Jun 02 15:46:56.420811 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.420791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/kube-rbac-proxy-web/0.log" Jun 02 15:46:56.442814 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.442790 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/kube-rbac-proxy/0.log" Jun 02 15:46:56.468723 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.468692 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/kube-rbac-proxy-metric/0.log" Jun 02 15:46:56.489827 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.489806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/prom-label-proxy/0.log" Jun 02 15:46:56.514159 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.514142 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b844f6fa-6aab-4c2e-b9f7-76e1b81014b7/init-config-reloader/0.log" Jun 02 15:46:56.599035 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.599009 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-kp7qm_aebc20e9-5c11-43b2-83bb-be6b9c50a52c/kube-state-metrics/0.log" Jun 02 15:46:56.623417 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.623335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-kp7qm_aebc20e9-5c11-43b2-83bb-be6b9c50a52c/kube-rbac-proxy-main/0.log" Jun 02 15:46:56.646969 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.646945 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-kp7qm_aebc20e9-5c11-43b2-83bb-be6b9c50a52c/kube-rbac-proxy-self/0.log" Jun 02 15:46:56.749378 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.749351 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l78xq_228f26aa-48ff-4037-a207-33f9a7d725b8/node-exporter/0.log" Jun 02 15:46:56.772386 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.772366 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l78xq_228f26aa-48ff-4037-a207-33f9a7d725b8/kube-rbac-proxy/0.log" Jun 02 15:46:56.795683 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:56.795638 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l78xq_228f26aa-48ff-4037-a207-33f9a7d725b8/init-textfile/0.log" Jun 02 15:46:57.021798 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.021720 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-ms4gg_01afe4ea-87af-435d-8e46-b8ebd3f39e3d/kube-rbac-proxy-main/0.log" Jun 02 15:46:57.048047 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.048027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-ms4gg_01afe4ea-87af-435d-8e46-b8ebd3f39e3d/kube-rbac-proxy-self/0.log" Jun 02 15:46:57.079397 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.079361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-ms4gg_01afe4ea-87af-435d-8e46-b8ebd3f39e3d/openshift-state-metrics/0.log" Jun 02 15:46:57.344438 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.344403 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-kbcj4_2d02ad11-6669-4bc2-990d-13cd6628e37f/prometheus-operator-admission-webhook/0.log" Jun 02 15:46:57.367789 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.367766 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d858759b6-qqxs5_c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe/telemeter-client/0.log" Jun 02 15:46:57.390659 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.390639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d858759b6-qqxs5_c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe/reload/0.log" Jun 02 15:46:57.418286 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:57.418268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d858759b6-qqxs5_c6ee13f8-357d-4f34-9cb6-03b7d4bd28fe/kube-rbac-proxy/0.log" Jun 02 15:46:58.645739 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.645712 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-pmb4z_252ea2b0-bc1c-4262-85b3-a81a958e4c42/networking-console-plugin/0.log" Jun 02 15:46:58.678147 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.678120 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx"] Jun 02 15:46:58.680803 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.680788 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.684462 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.684446 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzc9k\"/\"kube-root-ca.crt\"" Jun 02 15:46:58.684561 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.684552 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzc9k\"/\"default-dockercfg-7sr8k\"" Jun 02 15:46:58.685387 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.685374 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzc9k\"/\"openshift-service-ca.crt\"" Jun 02 15:46:58.697809 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.697787 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx"] Jun 02 15:46:58.720362 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.720342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7clwk\" (UniqueName: \"kubernetes.io/projected/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-kube-api-access-7clwk\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.720468 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.720375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-podres\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.720468 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.720406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-sys\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.720468 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.720424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-proc\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.720588 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.720524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-lib-modules\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821368 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821341 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-lib-modules\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821486 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821378 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7clwk\" (UniqueName: \"kubernetes.io/projected/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-kube-api-access-7clwk\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821486 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821398 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-podres\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821486 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821459 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-sys\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821649 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-podres\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821649 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-lib-modules\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821649 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821545 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-proc\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821649 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821553 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-sys\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.821649 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.821504 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-proc\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.830741 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.830720 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7clwk\" (UniqueName: \"kubernetes.io/projected/e66f87c5-2e62-4a0a-b0bd-187e2ca1098b-kube-api-access-7clwk\") pod \"perf-node-gather-daemonset-jb5lx\" (UID: \"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:58.990318 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:58.990237 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:59.131531 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.131510 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx"] Jun 02 15:46:59.133039 ip-10-0-141-151 kubenswrapper[2579]: W0602 15:46:59.133003 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode66f87c5_2e62_4a0a_b0bd_187e2ca1098b.slice/crio-00b76499268d3f36d1bd3ad1eff900f44c32576d88155f5e318a89c5615d792e WatchSource:0}: Error finding container 00b76499268d3f36d1bd3ad1eff900f44c32576d88155f5e318a89c5615d792e: Status 404 returned error can't find the container with id 00b76499268d3f36d1bd3ad1eff900f44c32576d88155f5e318a89c5615d792e Jun 02 15:46:59.134598 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.134582 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:46:59.286704 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.286613 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" event={"ID":"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b","Type":"ContainerStarted","Data":"3107c87402321148ce4a919cf6c367cffad92531427ae6cee702c079beb115d0"} Jun 02 15:46:59.286704 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.286652 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" event={"ID":"e66f87c5-2e62-4a0a-b0bd-187e2ca1098b","Type":"ContainerStarted","Data":"00b76499268d3f36d1bd3ad1eff900f44c32576d88155f5e318a89c5615d792e"} Jun 02 15:46:59.286882 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.286719 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:46:59.294710 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.294690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/1.log" Jun 02 15:46:59.302244 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.302226 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fsqt5_09660787-6b25-4901-929c-d7ba2324779c/console-operator/2.log" Jun 02 15:46:59.307198 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.307154 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" podStartSLOduration=1.307139117 podStartE2EDuration="1.307139117s" podCreationTimestamp="2026-06-02 15:46:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:46:59.306102845 +0000 UTC m=+1385.911795550" watchObservedRunningTime="2026-06-02 15:46:59.307139117 +0000 UTC m=+1385.912831812" Jun 02 15:46:59.801638 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.801609 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bb5ff4c98-9nktv_14f08024-2865-4637-859a-2fa127f291fa/console/0.log" Jun 02 15:46:59.834998 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:46:59.834977 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-b77m2_b89cb5b3-671a-4887-9c8b-fa5a229766d9/download-server/0.log" Jun 02 15:47:00.378307 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:00.378278 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-2d4pv_9afcac4b-c2a7-4817-a53b-5f932c8c821f/volume-data-source-validator/0.log" Jun 02 15:47:01.403163 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:01.403130 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwpvj_adec3c5a-94e4-4775-ba97-1573b0ab830e/dns/0.log" Jun 02 15:47:01.450747 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:01.450721 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwpvj_adec3c5a-94e4-4775-ba97-1573b0ab830e/kube-rbac-proxy/0.log" Jun 02 15:47:01.525895 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:01.525874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pdsnj_03565e0a-bb85-459f-8a11-65d33ab6d886/dns-node-resolver/0.log" Jun 02 15:47:02.045861 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:02.045830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2n8tv_d600b7e7-6b95-4a6f-b662-c9f0f117119c/node-ca/0.log" Jun 02 15:47:03.153327 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:03.153293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bcfb9d8b-7xckk_b2433887-4d33-4c10-b5bf-2ad46c9b3a72/kube-auth-proxy/0.log" Jun 02 15:47:03.901388 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:03.901358 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tptbf_5b201605-4a24-4ba3-9d3d-89b580fd04e0/serve-healthcheck-canary/0.log" Jun 02 15:47:04.379711 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:04.379686 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-56xdk_9bfdac31-e35f-456d-bb99-ac110f9d57dc/insights-operator/0.log" Jun 02 15:47:04.380488 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:04.380467 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-56xdk_9bfdac31-e35f-456d-bb99-ac110f9d57dc/insights-operator/1.log" Jun 02 15:47:04.537740 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:04.537710 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fq9wv_9407601b-f09f-4c04-bfb5-5986da15eabc/kube-rbac-proxy/0.log" Jun 02 15:47:04.556441 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:04.556414 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fq9wv_9407601b-f09f-4c04-bfb5-5986da15eabc/exporter/0.log" Jun 02 15:47:04.583188 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:04.583142 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fq9wv_9407601b-f09f-4c04-bfb5-5986da15eabc/extractor/0.log" Jun 02 15:47:05.301218 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:05.301193 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-jb5lx" Jun 02 15:47:06.797152 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:06.797124 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d9b6489bc-fvxr9_94889b4e-7583-4e79-8d1e-446b3835aaab/maas-api/0.log" Jun 02 15:47:06.855644 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:06.855618 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-594d58948c-lrzrx_49a3af9b-b721-4840-b2fc-a0e9a7f61bda/manager/0.log" Jun 02 15:47:07.109321 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:07.109292 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99_cd120c42-6313-4216-adb6-c9a1c0c97dfd/manager/0.log" Jun 02 15:47:07.130926 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:07.130898 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-pmt99_cd120c42-6313-4216-adb6-c9a1c0c97dfd/copy-manifests/0.log" Jun 02 15:47:08.751054 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:08.750955 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5546797fcb-8qtg9_5178d3db-9114-4856-bbf6-98f7017f75c1/manager/0.log" Jun 02 15:47:08.799624 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:08.799597 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-lfj4j_019eea57-6bc7-4e45-b702-5efb924fdb85/openshift-lws-operator/0.log" Jun 02 15:47:13.660057 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:13.660015 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-xnn7n_c9b08412-e8e3-4364-b733-2a041c6192a9/migrator/0.log" Jun 02 15:47:13.710420 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:13.710393 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-xnn7n_c9b08412-e8e3-4364-b733-2a041c6192a9/graceful-termination/0.log" Jun 02 15:47:15.300716 ip-10-0-141-151 kubenswrapper[2579]: I0602 15:47:15.300685 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j7jh4_4755447f-3fef-4dc6-b289-e1f10e3da9cb/kube-multus-additional-cni-plugins/0.log"