Jun 02 19:18:33.041102 ip-10-0-128-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 19:18:33.041119 ip-10-0-128-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 19:18:33.041130 ip-10-0-128-46 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 19:18:33.041496 ip-10-0-128-46 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 19:18:43.287761 ip-10-0-128-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 19:18:43.287780 ip-10-0-128-46 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2a8c12866591441ab2e5c7e205f51c09 -- Jun 02 19:21:13.465714 ip-10-0-128-46 systemd[1]: Starting Kubernetes Kubelet... Jun 02 19:21:13.994552 ip-10-0-128-46 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:21:13.994552 ip-10-0-128-46 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 19:21:13.994552 ip-10-0-128-46 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:21:13.994552 ip-10-0-128-46 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 19:21:13.994552 ip-10-0-128-46 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:21:13.995465 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.995363 2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 19:21:13.998955 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998940 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998956 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998960 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998964 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998973 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998976 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998979 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998982 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998985 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998988 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998990 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998993 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:21:13.998993 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.998997 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999002 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999005 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999008 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999010 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999012 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999016 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999018 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999021 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999024 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999027 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999029 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999032 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999035 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999038 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999040 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999043 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999045 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999047 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999050 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:21:13.999283 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999052 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999055 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999057 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999060 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999062 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999066 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999068 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999071 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999074 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999076 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999079 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999081 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999084 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999086 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999090 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999093 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999095 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999098 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999100 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:21:13.999763 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999103 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999105 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999108 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999110 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999113 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999115 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999118 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999120 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999124 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999126 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999128 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999131 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999134 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999137 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999139 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999142 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999144 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999147 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999149 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999153 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:21:14.000347 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999155 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999158 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999160 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999162 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999167 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999170 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999173 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999177 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999180 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999182 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999184 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999187 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999189 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999192 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999194 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999571 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999576 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999579 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999581 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:21:14.001075 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999584 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999587 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999589 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999592 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999595 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999597 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999600 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999603 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999605 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999608 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999610 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999613 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999617 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999619 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999622 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999625 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999628 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999631 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999634 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999636 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:21:14.001679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999641 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999643 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999646 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999648 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999651 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999653 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999655 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999658 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999660 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999663 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999666 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999668 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999671 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999673 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999676 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999679 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999681 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999684 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999687 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999689 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:21:14.002455 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999693 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999695 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999698 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999700 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999703 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999706 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999708 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999711 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999713 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999716 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999718 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999721 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999724 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999727 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999729 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999731 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999734 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999736 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999738 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999741 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:21:14.002967 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999743 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999746 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999748 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999750 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999753 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999755 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999760 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999764 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999771 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999774 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999776 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999779 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999781 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999785 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999788 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999790 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999793 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999796 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999799 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:21:14.003578 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999802 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999804 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:13.999807 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999874 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999881 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999887 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999891 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999899 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999902 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999906 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999910 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999914 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999917 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999920 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999923 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999927 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999930 2572 flags.go:64] FLAG: --cgroup-root="" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999932 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999936 2572 flags.go:64] FLAG: --client-ca-file="" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999939 2572 flags.go:64] FLAG: --cloud-config="" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999941 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999945 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999949 2572 flags.go:64] FLAG: --cluster-domain="" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999952 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 19:21:14.004126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999954 2572 flags.go:64] FLAG: --config-dir="" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999957 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999961 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999965 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999968 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999971 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999974 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:13.999977 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000021 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000275 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000285 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000292 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000300 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000306 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000313 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000324 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000329 2572 flags.go:64] FLAG: --enable-server="true" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000335 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000348 2572 flags.go:64] FLAG: --event-burst="100" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000354 2572 flags.go:64] FLAG: --event-qps="50" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000360 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000366 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000371 2572 flags.go:64] FLAG: --eviction-hard="" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000378 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 19:21:14.004940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000383 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000388 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000399 2572 flags.go:64] FLAG: --eviction-soft="" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000404 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000409 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000414 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000435 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000440 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000445 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000450 2572 flags.go:64] FLAG: --feature-gates="" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000461 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000467 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000472 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000477 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000483 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000489 2572 flags.go:64] FLAG: --help="false" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000494 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000542 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000550 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000560 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000566 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000571 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000576 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 19:21:14.005620 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000581 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000586 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000592 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000597 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000606 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000612 2572 flags.go:64] FLAG: --kube-reserved="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000617 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000622 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000627 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000632 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000636 2572 flags.go:64] FLAG: --lock-file="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000641 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000646 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000656 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000664 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000669 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000674 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000679 2572 flags.go:64] FLAG: --logging-format="text" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000690 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000695 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000700 2572 flags.go:64] FLAG: --manifest-url="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000709 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000716 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000721 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000728 2572 flags.go:64] FLAG: --max-pods="110" Jun 02 19:21:14.006214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000733 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000738 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000746 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000751 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000757 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000810 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000819 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000835 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000843 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000849 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000856 2572 flags.go:64] FLAG: --pod-cidr="" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000868 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000877 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000882 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000888 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000893 2572 flags.go:64] FLAG: --port="10250" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000898 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000903 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a5a1020319769938" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000909 2572 flags.go:64] FLAG: --qos-reserved="" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000915 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000925 2572 flags.go:64] FLAG: --register-node="true" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000929 2572 flags.go:64] FLAG: --register-schedulable="true" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000934 2572 flags.go:64] FLAG: --register-with-taints="" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000940 2572 flags.go:64] FLAG: --registry-burst="10" Jun 02 19:21:14.006839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000945 2572 flags.go:64] FLAG: --registry-qps="5" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.000949 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001370 2572 flags.go:64] FLAG: --reserved-memory="" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001552 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001560 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001567 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001573 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001578 2572 flags.go:64] FLAG: --runonce="false" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001583 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001588 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001594 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001599 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001605 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001610 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001616 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001621 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001626 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001631 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001636 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001641 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001646 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001651 2572 flags.go:64] FLAG: --system-cgroups="" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001656 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001669 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001674 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 02 19:21:14.007509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001678 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001686 2572 flags.go:64] FLAG: --tls-min-version="" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001691 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001696 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001700 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001706 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001711 2572 flags.go:64] FLAG: --v="2" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001718 2572 flags.go:64] FLAG: --version="false" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001726 2572 flags.go:64] FLAG: --vmodule="" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001733 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.001739 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001900 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001907 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001912 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001917 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001921 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001925 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001930 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001934 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001938 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001942 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001946 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:21:14.008130 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001951 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001955 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001960 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001964 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001968 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001973 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001977 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001982 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001986 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001990 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001995 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.001999 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002003 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002007 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002011 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002015 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002019 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002024 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002028 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002033 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:21:14.008679 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002038 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002043 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002047 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002052 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002056 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002063 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002070 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002075 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002080 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002085 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002090 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002094 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002098 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002102 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002106 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002110 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002115 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002119 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002124 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002128 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:21:14.009191 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002132 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002137 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002141 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002145 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002149 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002153 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002159 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002165 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002169 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002173 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002178 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002183 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002187 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002192 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002196 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002201 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002205 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002210 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002214 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:21:14.009732 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002218 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002222 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002226 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002231 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002235 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002240 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002244 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002248 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002252 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002257 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002261 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002265 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002270 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002274 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002278 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.002282 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:21:14.010251 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.003304 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:21:14.011383 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.011363 2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 19:21:14.011414 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.011385 2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 19:21:14.011467 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011457 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:21:14.011467 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011467 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011471 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011475 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011479 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011482 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011484 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011487 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011490 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011493 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011496 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011498 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011501 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011503 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011506 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011509 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011512 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011515 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011518 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011520 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:21:14.011528 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011523 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011526 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011528 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011531 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011535 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011539 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011543 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011545 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011548 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011552 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011555 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011557 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011560 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011562 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011565 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011567 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011571 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011573 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011576 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:21:14.011994 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011578 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011581 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011583 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011586 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011588 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011591 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011593 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011596 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011598 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011601 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011603 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011606 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011608 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011611 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011613 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011617 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011620 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011623 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011625 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011628 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:21:14.012510 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011631 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011633 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011636 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011639 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011641 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011644 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011647 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011651 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011654 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011656 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011659 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011661 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011664 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011666 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011669 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011671 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011674 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011676 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011679 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011681 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:21:14.012988 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011684 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011686 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011689 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011692 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011694 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011697 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011699 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.011705 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011805 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011810 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011813 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011817 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011821 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011823 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011826 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:21:14.013513 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011829 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011832 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011834 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011837 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011840 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011843 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011845 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011848 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011850 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011853 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011855 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011858 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011860 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011863 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011865 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011868 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011870 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011873 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011875 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011878 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:21:14.013920 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011881 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011883 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011885 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011888 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011891 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011894 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011897 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011900 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011902 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011905 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011908 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011910 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011913 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011915 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011919 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011921 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011924 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011926 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011929 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011931 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:21:14.014406 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011934 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011936 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011939 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011941 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011944 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011946 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011949 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011952 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011954 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011957 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011959 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011962 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011965 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011967 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011970 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011972 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011975 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011978 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011980 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:21:14.014902 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011983 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011985 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011988 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011990 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011993 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011995 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.011998 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012001 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012006 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012009 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012012 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012014 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012017 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012021 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012023 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012026 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012028 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012031 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012033 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:21:14.015358 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:14.012036 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:21:14.015837 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.012041 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:21:14.015837 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.012744 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 19:21:14.018001 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.017987 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 19:21:14.019737 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.019725 2572 server.go:1019] "Starting client certificate rotation" Jun 02 19:21:14.019836 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.019821 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:21:14.019873 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.019857 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:21:14.049279 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.049257 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:21:14.051201 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.051180 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:21:14.067463 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.067436 2572 log.go:25] "Validated CRI v1 runtime API" Jun 02 19:21:14.075346 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.075315 2572 log.go:25] "Validated CRI v1 image API" Jun 02 19:21:14.077029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.077010 2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 19:21:14.081096 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.081067 2572 fs.go:135] Filesystem UUIDs: map[346bea65-7c6d-422f-a993-82755c5eba2e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 989ccc98-9168-438d-bfa9-a3237c8a9292:/dev/nvme0n1p3] Jun 02 19:21:14.081096 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.081090 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 19:21:14.084882 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.084859 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:21:14.085643 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.085536 2572 manager.go:217] Machine: {Timestamp:2026-06-02 19:21:14.084952396 +0000 UTC m=+0.473997078 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099625 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f8ae98e9cc30b8cf5d9838b6bd33 SystemUUID:ec20f8ae-98e9-cc30-b8cf-5d9838b6bd33 BootID:2a8c1286-6591-441a-b2e5-c7e205f51c09 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:ed:05:64:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:ed:05:64:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:81:e6:95:93:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 19:21:14.086714 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.086704 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 19:21:14.086810 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.086797 2572 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 19:21:14.090489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.090460 2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 19:21:14.090631 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.090492 2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 19:21:14.090677 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.090641 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 19:21:14.090677 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.090648 2572 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 19:21:14.090677 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.090656 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:21:14.091449 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.091438 2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:21:14.092542 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.092531 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:21:14.092837 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.092827 2572 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 19:21:14.095308 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.095297 2572 kubelet.go:491] "Attempting to sync node with API server" Jun 02 19:21:14.095353 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.095316 2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 19:21:14.095353 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.095328 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 19:21:14.095353 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.095338 2572 kubelet.go:397] "Adding apiserver pod source" Jun 02 19:21:14.095353 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.095346 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 19:21:14.096523 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.096511 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:21:14.096569 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.096530 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:21:14.100050 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.100031 2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 19:21:14.102439 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.102411 2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 19:21:14.102702 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.102683 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhrl7" Jun 02 19:21:14.104562 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104549 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 19:21:14.104604 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104567 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 19:21:14.104604 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104574 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 19:21:14.104604 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104580 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 19:21:14.104604 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104592 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 19:21:14.104604 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104601 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 19:21:14.104744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104609 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 19:21:14.104744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104615 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 19:21:14.104744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104626 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 19:21:14.104744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104632 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 19:21:14.104744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104641 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 19:21:14.104744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.104646 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 19:21:14.105735 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.105725 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 19:21:14.105735 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.105736 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 19:21:14.107258 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.107220 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 19:21:14.107329 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.107271 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 19:21:14.108849 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.108835 2572 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 19:21:14.108914 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.108872 2572 server.go:1295] "Started kubelet" Jun 02 19:21:14.108970 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.108937 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 19:21:14.109016 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.108958 2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 19:21:14.109059 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.109018 2572 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 19:21:14.109708 ip-10-0-128-46 systemd[1]: Started Kubernetes Kubelet. Jun 02 19:21:14.110523 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.110434 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhrl7" Jun 02 19:21:14.110523 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.110445 2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 19:21:14.112019 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.112003 2572 server.go:317] "Adding debug handlers to kubelet server" Jun 02 19:21:14.116586 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.116568 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 19:21:14.117197 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.117176 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 19:21:14.120129 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.120100 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.120323 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.120305 2572 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 19:21:14.120400 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.120325 2572 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 19:21:14.120979 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.120965 2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 19:21:14.121288 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.121268 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 02 19:21:14.121288 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.121289 2572 reconciler.go:26] "Reconciler: start to sync state" Jun 02 19:21:14.122095 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122063 2572 factory.go:55] Registering systemd factory Jun 02 19:21:14.122095 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122089 2572 factory.go:223] Registration of the systemd container factory successfully Jun 02 19:21:14.122283 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.122263 2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 19:21:14.122678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122656 2572 factory.go:153] Registering CRI-O factory Jun 02 19:21:14.122747 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122681 2572 factory.go:223] Registration of the crio container factory successfully Jun 02 19:21:14.122790 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122757 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 19:21:14.122790 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122778 2572 factory.go:103] Registering Raw factory Jun 02 19:21:14.122883 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.122794 2572 manager.go:1196] Started watching for new ooms in manager Jun 02 19:21:14.123219 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.123198 2572 manager.go:319] Starting recovery of all containers Jun 02 19:21:14.125894 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.125878 2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-46.ec2.internal" not found Jun 02 19:21:14.126515 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.126492 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-46.ec2.internal\" not found" node="ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.129094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.129056 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:14.137411 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.137291 2572 manager.go:324] Recovery completed Jun 02 19:21:14.141462 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.141446 2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-46.ec2.internal" not found Jun 02 19:21:14.141547 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.141469 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:21:14.143527 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.143511 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:21:14.143595 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.143540 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:21:14.143595 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.143551 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:21:14.144075 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.144062 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 19:21:14.144123 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.144076 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 19:21:14.144123 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.144092 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:21:14.146530 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.146519 2572 policy_none.go:49] "None policy: Start" Jun 02 19:21:14.146579 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.146534 2572 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 19:21:14.146579 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.146544 2572 state_mem.go:35] "Initializing new in-memory state store" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.184789 2572 manager.go:341] "Starting Device Plugin manager" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.184821 2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.184832 2572 server.go:85] "Starting device plugin registration server" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.185094 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.185106 2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.185195 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.185273 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.185279 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.186937 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 19:21:14.193678 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.186976 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.200489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.200470 2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-46.ec2.internal" not found Jun 02 19:21:14.239561 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.239514 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 19:21:14.240775 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.240761 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 19:21:14.240838 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.240785 2572 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 19:21:14.240838 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.240804 2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 19:21:14.240838 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.240810 2572 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 19:21:14.240938 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.240852 2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 19:21:14.243535 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.243518 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:14.285741 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.285654 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:21:14.286654 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.286630 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:21:14.286754 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.286659 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:21:14.286754 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.286670 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:21:14.286754 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.286694 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.295637 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.295616 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.295696 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.295643 2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-46.ec2.internal\": node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.309737 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.309711 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.341517 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.341487 2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal"] Jun 02 19:21:14.341602 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.341581 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:21:14.342612 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.342591 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:21:14.342716 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.342619 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:21:14.342716 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.342630 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:21:14.344065 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344052 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:21:14.344223 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344208 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.344267 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344238 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:21:14.344814 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344797 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:21:14.344910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344823 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:21:14.344910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344832 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:21:14.344910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344803 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:21:14.344910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344897 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:21:14.344910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.344908 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:21:14.346750 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.346733 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.346853 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.346760 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:21:14.347474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.347458 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:21:14.347547 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.347484 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:21:14.347547 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.347493 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:21:14.361945 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.361927 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-46.ec2.internal\" not found" node="ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.366054 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.366039 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-46.ec2.internal\" not found" node="ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.410292 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.410269 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.422628 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.422611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/549a9d2e531584bc93f5268da0f94a1c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-46.ec2.internal\" (UID: \"549a9d2e531584bc93f5268da0f94a1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.422693 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.422633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42b63980546b8e519ff8f6b8815f49fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal\" (UID: \"42b63980546b8e519ff8f6b8815f49fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.422693 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.422652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b63980546b8e519ff8f6b8815f49fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal\" (UID: \"42b63980546b8e519ff8f6b8815f49fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.510541 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.510509 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.522910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.522888 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/549a9d2e531584bc93f5268da0f94a1c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-46.ec2.internal\" (UID: \"549a9d2e531584bc93f5268da0f94a1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.522972 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.522917 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42b63980546b8e519ff8f6b8815f49fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal\" (UID: \"42b63980546b8e519ff8f6b8815f49fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.522972 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.522936 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b63980546b8e519ff8f6b8815f49fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal\" (UID: \"42b63980546b8e519ff8f6b8815f49fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.523038 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.522975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b63980546b8e519ff8f6b8815f49fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal\" (UID: \"42b63980546b8e519ff8f6b8815f49fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.523038 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.523011 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/549a9d2e531584bc93f5268da0f94a1c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-46.ec2.internal\" (UID: \"549a9d2e531584bc93f5268da0f94a1c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.523098 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.523034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42b63980546b8e519ff8f6b8815f49fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal\" (UID: \"42b63980546b8e519ff8f6b8815f49fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.611319 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.611238 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.664787 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.664764 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.670293 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.670274 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:14.712157 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.712121 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.812712 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.812678 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.913291 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:14.913216 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:14.975882 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:14.975853 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:15.014198 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:15.014163 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:15.019326 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.019304 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 19:21:15.019488 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.019468 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:21:15.019533 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.019476 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:21:15.019533 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.019497 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:21:15.113216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.113176 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 19:16:14 +0000 UTC" deadline="2027-12-25 07:48:07.942175203 +0000 UTC" Jun 02 19:21:15.113216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.113211 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13692h26m52.828966867s" Jun 02 19:21:15.114239 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:15.114224 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:15.117388 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.117370 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 19:21:15.141482 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.141457 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:21:15.159804 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:15.159776 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549a9d2e531584bc93f5268da0f94a1c.slice/crio-55b89b5a6f55ac04181fcc9cc81a1e8cbce1b44b5ac0b786e7aa11ac4dfa1534 WatchSource:0}: Error finding container 55b89b5a6f55ac04181fcc9cc81a1e8cbce1b44b5ac0b786e7aa11ac4dfa1534: Status 404 returned error can't find the container with id 55b89b5a6f55ac04181fcc9cc81a1e8cbce1b44b5ac0b786e7aa11ac4dfa1534 Jun 02 19:21:15.161413 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:15.161383 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b63980546b8e519ff8f6b8815f49fe.slice/crio-2fcf6d9d631d10f8b61543b10432e2569d41421ddb9a8c0c0bd819624abbaa38 WatchSource:0}: Error finding container 2fcf6d9d631d10f8b61543b10432e2569d41421ddb9a8c0c0bd819624abbaa38: Status 404 returned error can't find the container with id 2fcf6d9d631d10f8b61543b10432e2569d41421ddb9a8c0c0bd819624abbaa38 Jun 02 19:21:15.165763 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.165745 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:21:15.173371 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.173353 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fl8lz" Jun 02 19:21:15.182311 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.182291 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fl8lz" Jun 02 19:21:15.214784 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:15.214745 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:15.244116 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.244067 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" event={"ID":"42b63980546b8e519ff8f6b8815f49fe","Type":"ContainerStarted","Data":"2fcf6d9d631d10f8b61543b10432e2569d41421ddb9a8c0c0bd819624abbaa38"} Jun 02 19:21:15.245001 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.244980 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" event={"ID":"549a9d2e531584bc93f5268da0f94a1c","Type":"ContainerStarted","Data":"55b89b5a6f55ac04181fcc9cc81a1e8cbce1b44b5ac0b786e7aa11ac4dfa1534"} Jun 02 19:21:15.315220 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:15.315192 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:15.415783 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:15.415712 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:15.516285 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:15.516255 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-46.ec2.internal\" not found" Jun 02 19:21:15.581453 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.581415 2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:15.621203 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.621132 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" Jun 02 19:21:15.632469 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.632444 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:21:15.633415 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.633391 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" Jun 02 19:21:15.642953 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.642930 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:21:15.903992 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:15.903916 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:16.011172 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.011144 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:16.096827 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.096792 2572 apiserver.go:52] "Watching apiserver" Jun 02 19:21:16.104832 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.104803 2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 19:21:16.106405 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.106375 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-s8855","openshift-cluster-node-tuning-operator/tuned-9f5t7","openshift-dns/node-resolver-dghj7","openshift-image-registry/node-ca-w29g5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal","openshift-multus/multus-additional-cni-plugins-nzd65","openshift-ovn-kubernetes/ovnkube-node-lgp2k","kube-system/konnectivity-agent-4x7xs","kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld","openshift-multus/multus-zr5bx","openshift-multus/network-metrics-daemon-wls57","openshift-network-diagnostics/network-check-target-nt4k6"] Jun 02 19:21:16.107997 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.107970 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.109164 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.109143 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.110414 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.110394 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.110414 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.110406 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 19:21:16.110786 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.110764 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 19:21:16.110786 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.110781 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 19:21:16.110935 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.110776 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.111700 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.111674 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 19:21:16.111810 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.111746 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.111810 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.111769 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lgqg4\"" Jun 02 19:21:16.111810 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.111783 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.111969 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.111832 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.112060 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.112036 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7w86s\"" Jun 02 19:21:16.112442 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.112405 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.113411 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.112586 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.114869 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.114101 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kbx86\"" Jun 02 19:21:16.114869 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.114342 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.115089 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.114847 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.116135 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.115988 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 19:21:16.116135 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.116008 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.116406 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.116388 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pmkp8\"" Jun 02 19:21:16.117170 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.117113 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.117641 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.117455 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.118744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.118723 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.119235 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.119176 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.119404 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.119385 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 19:21:16.119514 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.119462 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 19:21:16.119743 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.119725 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.120384 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.120361 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.120590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.120570 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fpt5d\"" Jun 02 19:21:16.120663 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.120624 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 19:21:16.120942 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.120907 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.121023 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.120964 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 19:21:16.121023 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.120999 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-knfhz\"" Jun 02 19:21:16.121105 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.121004 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.121105 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.121074 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 19:21:16.121347 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.121307 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q54x9\"" Jun 02 19:21:16.121347 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.121307 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 19:21:16.121798 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.121781 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.122788 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.122756 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 19:21:16.122910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.122805 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mgsss\"" Jun 02 19:21:16.122910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.122821 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 19:21:16.123127 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.123108 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.123227 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.123198 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:16.123290 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.123108 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 19:21:16.123905 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.123780 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 19:21:16.123905 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.123796 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s8m8r\"" Jun 02 19:21:16.124395 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.124378 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:16.124533 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.124501 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:16.131703 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-multus-certs\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.131789 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.131789 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cfe00ce-3ff3-4482-ade4-7f603b603193-iptables-alerter-script\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.131789 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107fb181-367b-4639-bd0d-30f53cf8e643-multus-daemon-config\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.131914 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-log-socket\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.131914 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.131914 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-modprobe-d\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.131914 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-kubernetes\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132108 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-run\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132108 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.131998 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwbp\" (UniqueName: \"kubernetes.io/projected/6cfe00ce-3ff3-4482-ade4-7f603b603193-kube-api-access-8bwbp\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.132108 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.132108 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107fb181-367b-4639-bd0d-30f53cf8e643-cni-binary-copy\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.132108 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-etc-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovnkube-config\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-var-lib-kubelet\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-cni-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.132317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqhg\" (UniqueName: \"kubernetes.io/projected/107fb181-367b-4639-bd0d-30f53cf8e643-kube-api-access-5vqhg\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-lib-modules\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-host\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-socket-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysconfig\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysctl-conf\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rz96\" (UniqueName: \"kubernetes.io/projected/61bc23d0-c51d-438f-b3a4-db72d02d91a5-kube-api-access-5rz96\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-socket-dir-parent\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-tuned\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-sys-fs\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-k8s-cni-cncf-io\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovnkube-script-lib\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysctl-d\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-conf-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovn-node-metrics-cert\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cfe00ce-3ff3-4482-ade4-7f603b603193-host-slash\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-systemd\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a22849c8-c59f-4dca-967d-8aabec2eff68-hosts-file\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.132973 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2mjh\" (UniqueName: \"kubernetes.io/projected/805fa8c7-d03a-4984-b55a-a2eee56b71af-kube-api-access-b2mjh\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.132984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/236b6c1c-bfd6-4ffc-b8af-91faa1ea0621-konnectivity-ca\") pod \"konnectivity-agent-4x7xs\" (UID: \"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621\") " pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-cni-netd\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-kubelet\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-run-netns\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-cni-bin\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-cnibin\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbl57\" (UniqueName: \"kubernetes.io/projected/a9cbc51d-5fed-4be1-8115-05c3844dba75-kube-api-access-bbl57\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-sys\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-registration-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pntb\" (UniqueName: \"kubernetes.io/projected/a22849c8-c59f-4dca-967d-8aabec2eff68-kube-api-access-2pntb\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-os-release\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-cni-multus\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-etc-kubernetes\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-node-log\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.133711 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21362d88-840e-495d-8b90-dcd5b39600f1-host\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-system-cni-dir\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133638 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-hostroot\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-systemd-units\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133683 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61bc23d0-c51d-438f-b3a4-db72d02d91a5-tmp\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g759b\" (UniqueName: \"kubernetes.io/projected/21362d88-840e-495d-8b90-dcd5b39600f1-kube-api-access-g759b\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/236b6c1c-bfd6-4ffc-b8af-91faa1ea0621-agent-certs\") pod \"konnectivity-agent-4x7xs\" (UID: \"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621\") " pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-slash\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-systemd\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21362d88-840e-495d-8b90-dcd5b39600f1-serviceca\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjnc9\" (UniqueName: \"kubernetes.io/projected/d52d7af6-026d-468a-8ff7-da4a8c06c31e-kube-api-access-bjnc9\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.133962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-system-cni-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-os-release\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-cni-bin\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-kubelet\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-var-lib-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-ovn\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.134501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-env-overrides\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.135282 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-device-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.135282 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22849c8-c59f-4dca-967d-8aabec2eff68-tmp-dir\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.135282 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-cnibin\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.135282 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.134401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-netns\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.183111 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.183078 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:16:15 +0000 UTC" deadline="2028-02-24 21:32:00.886402936 +0000 UTC" Jun 02 19:21:16.183111 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.183110 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15170h10m44.703297748s" Jun 02 19:21:16.222226 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.222198 2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 19:21:16.235068 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235041 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-cnibin\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235198 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235074 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbl57\" (UniqueName: \"kubernetes.io/projected/a9cbc51d-5fed-4be1-8115-05c3844dba75-kube-api-access-bbl57\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.235198 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235096 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-sys\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.235198 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235142 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-registration-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.235198 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-cnibin\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235198 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235172 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pntb\" (UniqueName: \"kubernetes.io/projected/a22849c8-c59f-4dca-967d-8aabec2eff68-kube-api-access-2pntb\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-sys\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235228 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-os-release\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235279 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235287 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-os-release\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235308 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-cni-multus\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235307 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-registration-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235334 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-etc-kubernetes\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235342 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235357 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-node-log\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235359 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-cni-multus\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235380 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21362d88-840e-495d-8b90-dcd5b39600f1-host\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235382 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-etc-kubernetes\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235390 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-node-log\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235414 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21362d88-840e-495d-8b90-dcd5b39600f1-host\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235441 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-system-cni-dir\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235463 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-hostroot\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-system-cni-dir\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.235478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235484 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-systemd-units\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235505 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61bc23d0-c51d-438f-b3a4-db72d02d91a5-tmp\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-hostroot\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235520 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g759b\" (UniqueName: \"kubernetes.io/projected/21362d88-840e-495d-8b90-dcd5b39600f1-kube-api-access-g759b\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235535 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/236b6c1c-bfd6-4ffc-b8af-91faa1ea0621-agent-certs\") pod \"konnectivity-agent-4x7xs\" (UID: \"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621\") " pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-systemd-units\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235551 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-slash\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235586 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-systemd\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235588 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-slash\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-systemd\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235715 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21362d88-840e-495d-8b90-dcd5b39600f1-serviceca\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235749 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjnc9\" (UniqueName: \"kubernetes.io/projected/d52d7af6-026d-468a-8ff7-da4a8c06c31e-kube-api-access-bjnc9\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235770 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-system-cni-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235792 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-os-release\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235809 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-cni-bin\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235831 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-kubelet\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235866 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-var-lib-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235884 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 19:21:16.236271 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235898 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-ovn\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235898 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-os-release\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235914 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-env-overrides\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235929 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-device-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235951 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22849c8-c59f-4dca-967d-8aabec2eff68-tmp-dir\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235955 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-system-cni-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235981 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-cnibin\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235986 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-var-lib-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235998 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-netns\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236020 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-netns\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236028 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-multus-certs\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-device-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236064 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236074 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-cnibin\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236099 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cfe00ce-3ff3-4482-ade4-7f603b603193-iptables-alerter-script\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236126 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107fb181-367b-4639-bd0d-30f53cf8e643-multus-daemon-config\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-kubelet\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236151 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-log-socket\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236168 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21362d88-840e-495d-8b90-dcd5b39600f1-serviceca\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236176 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-cni-bin\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236206 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-modprobe-d\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.235993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-ovn\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236256 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-kubernetes\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-multus-certs\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236283 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-run\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-modprobe-d\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236309 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwbp\" (UniqueName: \"kubernetes.io/projected/6cfe00ce-3ff3-4482-ade4-7f603b603193-kube-api-access-8bwbp\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236337 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22849c8-c59f-4dca-967d-8aabec2eff68-tmp-dir\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236363 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107fb181-367b-4639-bd0d-30f53cf8e643-cni-binary-copy\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236377 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-run\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236306 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/805fa8c7-d03a-4984-b55a-a2eee56b71af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236391 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-etc-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236455 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.237928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-kubernetes\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236483 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovnkube-config\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236527 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-var-lib-kubelet\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236549 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-cni-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236569 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236584 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqhg\" (UniqueName: \"kubernetes.io/projected/107fb181-367b-4639-bd0d-30f53cf8e643-kube-api-access-5vqhg\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236607 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-log-socket\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236628 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-lib-modules\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-env-overrides\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236659 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236648 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-host\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236692 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-socket-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236770 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-cni-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-var-lib-kubelet\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236843 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.238723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236861 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107fb181-367b-4639-bd0d-30f53cf8e643-multus-daemon-config\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-socket-dir\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236935 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-lib-modules\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236963 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysconfig\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236969 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-host\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.236989 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysctl-conf\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysconfig\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237038 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rz96\" (UniqueName: \"kubernetes.io/projected/61bc23d0-c51d-438f-b3a4-db72d02d91a5-kube-api-access-5rz96\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cfe00ce-3ff3-4482-ade4-7f603b603193-iptables-alerter-script\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237102 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysctl-conf\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237137 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237166 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-socket-dir-parent\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237191 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-tuned\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237245 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-socket-dir-parent\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrjm\" (UniqueName: \"kubernetes.io/projected/e23bb9ac-98b9-4039-9dec-4c57e10592bc-kube-api-access-sxrjm\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237331 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-sys-fs\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.240212 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237359 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-k8s-cni-cncf-io\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237384 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovnkube-script-lib\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237410 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysctl-d\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237432 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d52d7af6-026d-468a-8ff7-da4a8c06c31e-sys-fs\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237455 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-conf-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237482 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovn-node-metrics-cert\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237503 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-run-k8s-cni-cncf-io\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237509 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237537 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cfe00ce-3ff3-4482-ade4-7f603b603193-host-slash\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237560 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-systemd\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237602 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-sysctl-d\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237618 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a22849c8-c59f-4dca-967d-8aabec2eff68-hosts-file\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237646 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237664 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-multus-conf-dir\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237692 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2mjh\" (UniqueName: \"kubernetes.io/projected/805fa8c7-d03a-4984-b55a-a2eee56b71af-kube-api-access-b2mjh\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.240841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237719 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/236b6c1c-bfd6-4ffc-b8af-91faa1ea0621-konnectivity-ca\") pod \"konnectivity-agent-4x7xs\" (UID: \"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621\") " pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237744 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-cni-netd\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovnkube-config\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237769 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-kubelet\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237764 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-run-systemd\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237809 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-run-netns\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237831 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a22849c8-c59f-4dca-967d-8aabec2eff68-hosts-file\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237835 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-cni-bin\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.237869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-cni-bin\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovnkube-script-lib\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238306 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238343 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/236b6c1c-bfd6-4ffc-b8af-91faa1ea0621-konnectivity-ca\") pod \"konnectivity-agent-4x7xs\" (UID: \"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621\") " pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238367 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107fb181-367b-4639-bd0d-30f53cf8e643-host-var-lib-kubelet\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238408 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cfe00ce-3ff3-4482-ade4-7f603b603193-host-slash\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-run-netns\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-host-cni-netd\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238591 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9cbc51d-5fed-4be1-8115-05c3844dba75-etc-openvswitch\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238622 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107fb181-367b-4639-bd0d-30f53cf8e643-cni-binary-copy\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.241531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.238711 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/805fa8c7-d03a-4984-b55a-a2eee56b71af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.242365 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.239752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/236b6c1c-bfd6-4ffc-b8af-91faa1ea0621-agent-certs\") pod \"konnectivity-agent-4x7xs\" (UID: \"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621\") " pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.242365 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.240041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61bc23d0-c51d-438f-b3a4-db72d02d91a5-tmp\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.242365 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.240289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9cbc51d-5fed-4be1-8115-05c3844dba75-ovn-node-metrics-cert\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.242365 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.240550 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61bc23d0-c51d-438f-b3a4-db72d02d91a5-etc-tuned\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.244088 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.244028 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjnc9\" (UniqueName: \"kubernetes.io/projected/d52d7af6-026d-468a-8ff7-da4a8c06c31e-kube-api-access-bjnc9\") pod \"aws-ebs-csi-driver-node-lnhld\" (UID: \"d52d7af6-026d-468a-8ff7-da4a8c06c31e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.244722 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.244663 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqhg\" (UniqueName: \"kubernetes.io/projected/107fb181-367b-4639-bd0d-30f53cf8e643-kube-api-access-5vqhg\") pod \"multus-zr5bx\" (UID: \"107fb181-367b-4639-bd0d-30f53cf8e643\") " pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.244864 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.244739 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pntb\" (UniqueName: \"kubernetes.io/projected/a22849c8-c59f-4dca-967d-8aabec2eff68-kube-api-access-2pntb\") pod \"node-resolver-dghj7\" (UID: \"a22849c8-c59f-4dca-967d-8aabec2eff68\") " pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.245542 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.245522 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbl57\" (UniqueName: \"kubernetes.io/projected/a9cbc51d-5fed-4be1-8115-05c3844dba75-kube-api-access-bbl57\") pod \"ovnkube-node-lgp2k\" (UID: \"a9cbc51d-5fed-4be1-8115-05c3844dba75\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.248094 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.248071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwbp\" (UniqueName: \"kubernetes.io/projected/6cfe00ce-3ff3-4482-ade4-7f603b603193-kube-api-access-8bwbp\") pod \"iptables-alerter-s8855\" (UID: \"6cfe00ce-3ff3-4482-ade4-7f603b603193\") " pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.249501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.248458 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g759b\" (UniqueName: \"kubernetes.io/projected/21362d88-840e-495d-8b90-dcd5b39600f1-kube-api-access-g759b\") pod \"node-ca-w29g5\" (UID: \"21362d88-840e-495d-8b90-dcd5b39600f1\") " pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.249501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.248720 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rz96\" (UniqueName: \"kubernetes.io/projected/61bc23d0-c51d-438f-b3a4-db72d02d91a5-kube-api-access-5rz96\") pod \"tuned-9f5t7\" (UID: \"61bc23d0-c51d-438f-b3a4-db72d02d91a5\") " pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.249501 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.249273 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2mjh\" (UniqueName: \"kubernetes.io/projected/805fa8c7-d03a-4984-b55a-a2eee56b71af-kube-api-access-b2mjh\") pod \"multus-additional-cni-plugins-nzd65\" (UID: \"805fa8c7-d03a-4984-b55a-a2eee56b71af\") " pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.338576 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.338543 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.338761 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.338586 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrjm\" (UniqueName: \"kubernetes.io/projected/e23bb9ac-98b9-4039-9dec-4c57e10592bc-kube-api-access-sxrjm\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.338761 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.338616 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:16.338761 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.338735 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:16.338917 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.338879 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:21:16.838814 +0000 UTC m=+3.227858680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:16.346465 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.346436 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:16.346465 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.346460 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:16.346705 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.346473 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:16.346705 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.346556 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:16.846540184 +0000 UTC m=+3.235584850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:16.348322 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.348293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrjm\" (UniqueName: \"kubernetes.io/projected/e23bb9ac-98b9-4039-9dec-4c57e10592bc-kube-api-access-sxrjm\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.423084 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.423010 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:16.429882 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.429857 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" Jun 02 19:21:16.438938 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.438914 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dghj7" Jun 02 19:21:16.443493 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.443470 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w29g5" Jun 02 19:21:16.451010 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.450991 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nzd65" Jun 02 19:21:16.459524 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.459504 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s8855" Jun 02 19:21:16.466059 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.466042 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:16.472591 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.472573 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" Jun 02 19:21:16.479133 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.479114 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zr5bx" Jun 02 19:21:16.774442 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.774391 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22849c8_c59f_4dca_967d_8aabec2eff68.slice/crio-b8e0d3085b5a379ebe4c58f458a882f5bffa1ed299840998740ee56495cbf782 WatchSource:0}: Error finding container b8e0d3085b5a379ebe4c58f458a882f5bffa1ed299840998740ee56495cbf782: Status 404 returned error can't find the container with id b8e0d3085b5a379ebe4c58f458a882f5bffa1ed299840998740ee56495cbf782 Jun 02 19:21:16.776051 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.775938 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107fb181_367b_4639_bd0d_30f53cf8e643.slice/crio-8e846d1b281e9558e86dbdec8f82755fa63e23dd378cb96485100f5e88be705f WatchSource:0}: Error finding container 8e846d1b281e9558e86dbdec8f82755fa63e23dd378cb96485100f5e88be705f: Status 404 returned error can't find the container with id 8e846d1b281e9558e86dbdec8f82755fa63e23dd378cb96485100f5e88be705f Jun 02 19:21:16.777820 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.777796 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bc23d0_c51d_438f_b3a4_db72d02d91a5.slice/crio-a279eeb337deffefa9fe65621c8ebd8b70ddb78f330566bbc7bf1f7c5af0ce33 WatchSource:0}: Error finding container a279eeb337deffefa9fe65621c8ebd8b70ddb78f330566bbc7bf1f7c5af0ce33: Status 404 returned error can't find the container with id a279eeb337deffefa9fe65621c8ebd8b70ddb78f330566bbc7bf1f7c5af0ce33 Jun 02 19:21:16.779734 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.779711 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cbc51d_5fed_4be1_8115_05c3844dba75.slice/crio-a7d760d7d4b98bc60a09281613af359afec465de68955f3e73ec900bbe57597b WatchSource:0}: Error finding container a7d760d7d4b98bc60a09281613af359afec465de68955f3e73ec900bbe57597b: Status 404 returned error can't find the container with id a7d760d7d4b98bc60a09281613af359afec465de68955f3e73ec900bbe57597b Jun 02 19:21:16.780892 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.780869 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805fa8c7_d03a_4984_b55a_a2eee56b71af.slice/crio-bf3227ef12e6f9a496bfef2f407c84f3a5c8a521002bf1a60ad9b82c35cd5c4a WatchSource:0}: Error finding container bf3227ef12e6f9a496bfef2f407c84f3a5c8a521002bf1a60ad9b82c35cd5c4a: Status 404 returned error can't find the container with id bf3227ef12e6f9a496bfef2f407c84f3a5c8a521002bf1a60ad9b82c35cd5c4a Jun 02 19:21:16.781523 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.781317 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfe00ce_3ff3_4482_ade4_7f603b603193.slice/crio-8c2c617c51db5ebbf7883dd8e88a5c716da25d10975c36e2f832e66553569c29 WatchSource:0}: Error finding container 8c2c617c51db5ebbf7883dd8e88a5c716da25d10975c36e2f832e66553569c29: Status 404 returned error can't find the container with id 8c2c617c51db5ebbf7883dd8e88a5c716da25d10975c36e2f832e66553569c29 Jun 02 19:21:16.782521 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.782386 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21362d88_840e_495d_8b90_dcd5b39600f1.slice/crio-f66b657a266645b58ceef8f92239f5a1ac6765ac7dcdcf97da131a1bb1a5860e WatchSource:0}: Error finding container f66b657a266645b58ceef8f92239f5a1ac6765ac7dcdcf97da131a1bb1a5860e: Status 404 returned error can't find the container with id f66b657a266645b58ceef8f92239f5a1ac6765ac7dcdcf97da131a1bb1a5860e Jun 02 19:21:16.783835 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.783813 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236b6c1c_bfd6_4ffc_b8af_91faa1ea0621.slice/crio-04b574e956dbb0242c66d61c78c13f094056335f163085bfe953ffa9b657b030 WatchSource:0}: Error finding container 04b574e956dbb0242c66d61c78c13f094056335f163085bfe953ffa9b657b030: Status 404 returned error can't find the container with id 04b574e956dbb0242c66d61c78c13f094056335f163085bfe953ffa9b657b030 Jun 02 19:21:16.785331 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:21:16.785296 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52d7af6_026d_468a_8ff7_da4a8c06c31e.slice/crio-027204ce15e5c28a1b205d4ef61dc21e81825c2c843395c2ec885a055f4ad0fc WatchSource:0}: Error finding container 027204ce15e5c28a1b205d4ef61dc21e81825c2c843395c2ec885a055f4ad0fc: Status 404 returned error can't find the container with id 027204ce15e5c28a1b205d4ef61dc21e81825c2c843395c2ec885a055f4ad0fc Jun 02 19:21:16.841509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.841330 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:16.841658 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.841475 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:16.841658 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.841578 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:21:17.841559112 +0000 UTC m=+4.230603795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:16.942521 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:16.942485 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:16.942696 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.942639 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:16.942696 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.942666 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:16.942696 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.942679 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:16.942806 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:16.942747 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:17.942727253 +0000 UTC m=+4.331771937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:17.184588 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.184542 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:16:15 +0000 UTC" deadline="2027-11-29 14:36:41.779683415 +0000 UTC" Jun 02 19:21:17.184588 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.184586 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13075h15m24.595100405s" Jun 02 19:21:17.258626 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.258315 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dghj7" event={"ID":"a22849c8-c59f-4dca-967d-8aabec2eff68","Type":"ContainerStarted","Data":"b8e0d3085b5a379ebe4c58f458a882f5bffa1ed299840998740ee56495cbf782"} Jun 02 19:21:17.282741 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.282657 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" event={"ID":"549a9d2e531584bc93f5268da0f94a1c","Type":"ContainerStarted","Data":"06c0f24b8fe2de25b887c9cf14c0ffb3cac8c3d2c06e72b09bc58603a48c07f3"} Jun 02 19:21:17.292257 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.292209 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" event={"ID":"d52d7af6-026d-468a-8ff7-da4a8c06c31e","Type":"ContainerStarted","Data":"027204ce15e5c28a1b205d4ef61dc21e81825c2c843395c2ec885a055f4ad0fc"} Jun 02 19:21:17.295812 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.295781 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4x7xs" event={"ID":"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621","Type":"ContainerStarted","Data":"04b574e956dbb0242c66d61c78c13f094056335f163085bfe953ffa9b657b030"} Jun 02 19:21:17.308903 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.308871 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s8855" event={"ID":"6cfe00ce-3ff3-4482-ade4-7f603b603193","Type":"ContainerStarted","Data":"8c2c617c51db5ebbf7883dd8e88a5c716da25d10975c36e2f832e66553569c29"} Jun 02 19:21:17.318205 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.318128 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerStarted","Data":"bf3227ef12e6f9a496bfef2f407c84f3a5c8a521002bf1a60ad9b82c35cd5c4a"} Jun 02 19:21:17.320222 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.320155 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zr5bx" event={"ID":"107fb181-367b-4639-bd0d-30f53cf8e643","Type":"ContainerStarted","Data":"8e846d1b281e9558e86dbdec8f82755fa63e23dd378cb96485100f5e88be705f"} Jun 02 19:21:17.325827 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.325022 2572 generic.go:358] "Generic (PLEG): container finished" podID="42b63980546b8e519ff8f6b8815f49fe" containerID="2c7fea4f1e5b87368abd39fd5bbdb69986acd689df07f2dcb45e81f78190058f" exitCode=0 Jun 02 19:21:17.325827 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.325092 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" event={"ID":"42b63980546b8e519ff8f6b8815f49fe","Type":"ContainerDied","Data":"2c7fea4f1e5b87368abd39fd5bbdb69986acd689df07f2dcb45e81f78190058f"} Jun 02 19:21:17.341194 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.341137 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-46.ec2.internal" podStartSLOduration=2.341120995 podStartE2EDuration="2.341120995s" podCreationTimestamp="2026-06-02 19:21:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:21:17.299374084 +0000 UTC m=+3.688418770" watchObservedRunningTime="2026-06-02 19:21:17.341120995 +0000 UTC m=+3.730165684" Jun 02 19:21:17.349812 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.349497 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w29g5" event={"ID":"21362d88-840e-495d-8b90-dcd5b39600f1","Type":"ContainerStarted","Data":"f66b657a266645b58ceef8f92239f5a1ac6765ac7dcdcf97da131a1bb1a5860e"} Jun 02 19:21:17.366012 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.365061 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"a7d760d7d4b98bc60a09281613af359afec465de68955f3e73ec900bbe57597b"} Jun 02 19:21:17.384577 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.384543 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" event={"ID":"61bc23d0-c51d-438f-b3a4-db72d02d91a5","Type":"ContainerStarted","Data":"a279eeb337deffefa9fe65621c8ebd8b70ddb78f330566bbc7bf1f7c5af0ce33"} Jun 02 19:21:17.853300 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.852569 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:17.853300 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:17.852805 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:17.853300 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:17.852872 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:21:19.85285213 +0000 UTC m=+6.241896798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:17.953335 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:17.953248 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:17.953540 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:17.953463 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:17.953540 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:17.953486 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:17.953540 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:17.953500 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:17.953701 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:17.953563 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:19.953542678 +0000 UTC m=+6.342587358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:18.078323 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:18.078265 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:21:18.244500 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:18.244468 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:18.244888 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:18.244608 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:18.245037 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:18.245019 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:18.245128 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:18.245109 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:18.403634 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:18.403493 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" event={"ID":"42b63980546b8e519ff8f6b8815f49fe","Type":"ContainerStarted","Data":"6fe193a1fcadf27ae1fe72487ef1803120f4b48fb791333da31064c134d879c1"} Jun 02 19:21:19.868870 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:19.868838 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:19.869307 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:19.868974 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:19.869307 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:19.869040 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:21:23.869021644 +0000 UTC m=+10.258066323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:19.969784 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:19.969748 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:19.969949 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:19.969900 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:19.969949 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:19.969924 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:19.970046 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:19.969965 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:19.970046 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:19.970029 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:23.970008366 +0000 UTC m=+10.359053046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:20.242044 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:20.241927 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:20.242044 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:20.241951 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:20.242287 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:20.242082 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:20.242287 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:20.242168 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:22.242444 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:22.241913 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:22.242444 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:22.241947 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:22.242444 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:22.242061 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:22.242444 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:22.242184 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:23.903149 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:23.903108 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:23.903643 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:23.903272 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:23.903643 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:23.903350 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:21:31.903328428 +0000 UTC m=+18.292373101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:24.003889 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:24.003853 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:24.004060 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:24.004011 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:24.004060 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:24.004025 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:24.004060 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:24.004033 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:24.004236 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:24.004087 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:32.004072968 +0000 UTC m=+18.393117633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:24.241505 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:24.241473 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:24.241703 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:24.241613 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:24.243207 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:24.243150 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:24.243329 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:24.243249 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:26.245152 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:26.245125 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:26.245152 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:26.245148 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:26.245626 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:26.245220 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:26.245626 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:26.245370 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:28.244378 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:28.244342 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:28.244817 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:28.244348 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:28.244817 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:28.244479 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:28.244817 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:28.244544 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:30.241150 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:30.241115 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:30.241614 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:30.241115 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:30.241614 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:30.241251 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:30.241614 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:30.241353 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:31.960003 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:31.959962 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:31.960458 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:31.960114 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:31.960458 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:31.960183 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:21:47.960161038 +0000 UTC m=+34.349205708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:32.061257 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:32.061216 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:32.061521 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:32.061379 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:32.061521 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:32.061397 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:32.061521 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:32.061406 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:32.061521 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:32.061480 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:48.061465671 +0000 UTC m=+34.450510356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:32.241532 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:32.241488 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:32.241693 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:32.241500 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:32.241693 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:32.241622 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:32.241693 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:32.241676 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:34.242032 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:34.241995 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:34.242407 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:34.242003 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:34.242407 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:34.242093 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:34.242407 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:34.242176 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:35.435992 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.435689 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" event={"ID":"d52d7af6-026d-468a-8ff7-da4a8c06c31e","Type":"ContainerStarted","Data":"83d593b068d19878a2e4e284965596a241e940fa645a04672f91b16e455820c3"} Jun 02 19:21:35.437163 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.437137 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4x7xs" event={"ID":"236b6c1c-bfd6-4ffc-b8af-91faa1ea0621","Type":"ContainerStarted","Data":"af051b2bcff658b5332be7c99394d84e09ce57112aef4dbc3a6df50aabc510ce"} Jun 02 19:21:35.438961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.438853 2572 generic.go:358] "Generic (PLEG): container finished" podID="805fa8c7-d03a-4984-b55a-a2eee56b71af" containerID="499d8897d05e059d3ab03e9239e49976db12956cb1850a0a41fd4b52d3128fa6" exitCode=0 Jun 02 19:21:35.438961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.438930 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerDied","Data":"499d8897d05e059d3ab03e9239e49976db12956cb1850a0a41fd4b52d3128fa6"} Jun 02 19:21:35.441196 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.441174 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zr5bx" event={"ID":"107fb181-367b-4639-bd0d-30f53cf8e643","Type":"ContainerStarted","Data":"0a91f4db2fe2ffcaa63829c28506ab67eb56a9664ab52bcf4edd71f0b806e580"} Jun 02 19:21:35.443157 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.443135 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w29g5" event={"ID":"21362d88-840e-495d-8b90-dcd5b39600f1","Type":"ContainerStarted","Data":"6060e098af1e701c1b28f3bd9cd930d65beba656178afabcb5172d6c14abbb09"} Jun 02 19:21:35.446111 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446090 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:21:35.446513 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446478 2572 generic.go:358] "Generic (PLEG): container finished" podID="a9cbc51d-5fed-4be1-8115-05c3844dba75" containerID="c7ead798869fd6260de6928866ca1f632b583152425f4f0baf9623d306f7bd57" exitCode=1 Jun 02 19:21:35.446617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446543 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"43089e5349550063301cd7a80d3c6a7aad173fa1be367623160ca1f44b3becc8"} Jun 02 19:21:35.446617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446564 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"7d15e35748b7198d55443395dfa5aca0bbcaf58436c1a2f66ff69ce7f0243208"} Jun 02 19:21:35.446617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446576 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"c6920ebc02b1af1ca5b45a8a74c181ff081c2763218ee342f1c2d249c2cfaee3"} Jun 02 19:21:35.446617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446587 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"b975d602661433b61fc8078f4cba2963dd807f33b0afbc3c204ab5a4106d3437"} Jun 02 19:21:35.446617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446596 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerDied","Data":"c7ead798869fd6260de6928866ca1f632b583152425f4f0baf9623d306f7bd57"} Jun 02 19:21:35.446617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.446608 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"99bd5ae22a8b8f4c943d18a220ab054a3effe7ba13c9dc4626eb829093dbc842"} Jun 02 19:21:35.448188 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.448160 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" event={"ID":"61bc23d0-c51d-438f-b3a4-db72d02d91a5","Type":"ContainerStarted","Data":"c15154379d02fb65b00aa6c8dcf23aacbf8531e347cc60b2ef924fe446262df1"} Jun 02 19:21:35.449724 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.449702 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dghj7" event={"ID":"a22849c8-c59f-4dca-967d-8aabec2eff68","Type":"ContainerStarted","Data":"ed4aa3295ebc7f90e5c5e31e11da9cbf3734c2d3ee24a2a15345c45a0e038b31"} Jun 02 19:21:35.452326 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.452291 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-46.ec2.internal" podStartSLOduration=20.452279681 podStartE2EDuration="20.452279681s" podCreationTimestamp="2026-06-02 19:21:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:21:18.417318796 +0000 UTC m=+4.806363486" watchObservedRunningTime="2026-06-02 19:21:35.452279681 +0000 UTC m=+21.841324384" Jun 02 19:21:35.452699 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.452665 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4x7xs" podStartSLOduration=11.59146527 podStartE2EDuration="21.452656698s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.787855678 +0000 UTC m=+3.176900343" lastFinishedPulling="2026-06-02 19:21:26.6490471 +0000 UTC m=+13.038091771" observedRunningTime="2026-06-02 19:21:35.452247884 +0000 UTC m=+21.841292569" watchObservedRunningTime="2026-06-02 19:21:35.452656698 +0000 UTC m=+21.841701391" Jun 02 19:21:35.466757 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.466713 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w29g5" podStartSLOduration=3.421798631 podStartE2EDuration="21.46670187s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.78518764 +0000 UTC m=+3.174232305" lastFinishedPulling="2026-06-02 19:21:34.830090874 +0000 UTC m=+21.219135544" observedRunningTime="2026-06-02 19:21:35.46667064 +0000 UTC m=+21.855715327" watchObservedRunningTime="2026-06-02 19:21:35.46670187 +0000 UTC m=+21.855746557" Jun 02 19:21:35.489056 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.488994 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9f5t7" podStartSLOduration=3.436988471 podStartE2EDuration="21.488974892s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.779588959 +0000 UTC m=+3.168633624" lastFinishedPulling="2026-06-02 19:21:34.831575374 +0000 UTC m=+21.220620045" observedRunningTime="2026-06-02 19:21:35.488340734 +0000 UTC m=+21.877385422" watchObservedRunningTime="2026-06-02 19:21:35.488974892 +0000 UTC m=+21.878019581" Jun 02 19:21:35.503299 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.503250 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dghj7" podStartSLOduration=3.449814295 podStartE2EDuration="21.503232494s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.77668574 +0000 UTC m=+3.165730407" lastFinishedPulling="2026-06-02 19:21:34.830103924 +0000 UTC m=+21.219148606" observedRunningTime="2026-06-02 19:21:35.502921186 +0000 UTC m=+21.891965876" watchObservedRunningTime="2026-06-02 19:21:35.503232494 +0000 UTC m=+21.892277183" Jun 02 19:21:35.540790 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.540730 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zr5bx" podStartSLOduration=3.4794803 podStartE2EDuration="21.540711227s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.778550491 +0000 UTC m=+3.167595156" lastFinishedPulling="2026-06-02 19:21:34.839781416 +0000 UTC m=+21.228826083" observedRunningTime="2026-06-02 19:21:35.54063689 +0000 UTC m=+21.929681579" watchObservedRunningTime="2026-06-02 19:21:35.540711227 +0000 UTC m=+21.929755916" Jun 02 19:21:35.879687 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:35.879626 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 19:21:36.200309 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.200128 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T19:21:35.879649128Z","UUID":"0085aa78-5733-4b75-8bbf-1c05055a1c27","Handler":null,"Name":"","Endpoint":""} Jun 02 19:21:36.202173 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.202149 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 19:21:36.202385 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.202179 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 19:21:36.241402 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.241370 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:36.241589 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.241370 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:36.241589 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:36.241521 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:36.241724 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:36.241693 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:36.454310 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.454233 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" event={"ID":"d52d7af6-026d-468a-8ff7-da4a8c06c31e","Type":"ContainerStarted","Data":"079282704a108204f38d15ce108f5b57eb6f1eb026c896a991afdc1e1a9899b3"} Jun 02 19:21:36.456062 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.455986 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s8855" event={"ID":"6cfe00ce-3ff3-4482-ade4-7f603b603193","Type":"ContainerStarted","Data":"eb179c28767f18cb8ce69b2605e5e1dd5f29cc8a607b0a6499ffb2e056457f73"} Jun 02 19:21:36.481038 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:36.480977 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s8855" podStartSLOduration=12.615083675 podStartE2EDuration="22.480960701s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.783148482 +0000 UTC m=+3.172193149" lastFinishedPulling="2026-06-02 19:21:26.64902551 +0000 UTC m=+13.038070175" observedRunningTime="2026-06-02 19:21:36.480892619 +0000 UTC m=+22.869937307" watchObservedRunningTime="2026-06-02 19:21:36.480960701 +0000 UTC m=+22.870005390" Jun 02 19:21:37.461084 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:37.461058 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:21:37.464108 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:37.464078 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" event={"ID":"d52d7af6-026d-468a-8ff7-da4a8c06c31e","Type":"ContainerStarted","Data":"84ab969e04168b21487dda004055fb80c43738cd41956f1fd512e06efa18dc1e"} Jun 02 19:21:37.484233 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:37.484180 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnhld" podStartSLOduration=3.66886641 podStartE2EDuration="23.484162648s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.787909002 +0000 UTC m=+3.176953672" lastFinishedPulling="2026-06-02 19:21:36.603205242 +0000 UTC m=+22.992249910" observedRunningTime="2026-06-02 19:21:37.483645363 +0000 UTC m=+23.872690061" watchObservedRunningTime="2026-06-02 19:21:37.484162648 +0000 UTC m=+23.873207336" Jun 02 19:21:38.241340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:38.241096 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:38.241555 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:38.241466 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:38.241555 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:38.241137 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:38.241686 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:38.241647 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:38.469333 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:38.469307 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:21:38.469758 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:38.469682 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"61bfac1203b8e6ff9051a3f19a547d182036d3e22f090da020e931cf0388ebc7"} Jun 02 19:21:38.943829 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:38.943794 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:38.944557 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:38.944535 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:40.241727 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.241556 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:40.242380 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.241582 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:40.242380 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:40.241814 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:40.242380 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:40.241916 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:40.475204 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.475169 2572 generic.go:358] "Generic (PLEG): container finished" podID="805fa8c7-d03a-4984-b55a-a2eee56b71af" containerID="fb07651287f16b52f93c83ef7afd0986ee82c5eec06af35d0a433b4e51efb560" exitCode=0 Jun 02 19:21:40.475347 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.475251 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerDied","Data":"fb07651287f16b52f93c83ef7afd0986ee82c5eec06af35d0a433b4e51efb560"} Jun 02 19:21:40.478202 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.478182 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:21:40.478583 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.478563 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"29ab80670867cac633debc0a81876ed6c9623c6d9d467e4278bb12bd7d351090"} Jun 02 19:21:40.478878 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.478798 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:40.478878 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.478839 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:40.478988 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.478973 2572 scope.go:117] "RemoveContainer" containerID="c7ead798869fd6260de6928866ca1f632b583152425f4f0baf9623d306f7bd57" Jun 02 19:21:40.495369 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:40.495345 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:41.486689 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.486642 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:21:41.487794 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.487753 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" event={"ID":"a9cbc51d-5fed-4be1-8115-05c3844dba75","Type":"ContainerStarted","Data":"a288f6c711202817ada6caa7c09ef68f5d167478a370c2bdebaa13c920db7aa5"} Jun 02 19:21:41.488175 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.488148 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:41.514550 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.514521 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:21:41.516329 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.516276 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" podStartSLOduration=9.390808452 podStartE2EDuration="27.51625993s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.781743204 +0000 UTC m=+3.170787870" lastFinishedPulling="2026-06-02 19:21:34.907194681 +0000 UTC m=+21.296239348" observedRunningTime="2026-06-02 19:21:41.514372872 +0000 UTC m=+27.903417600" watchObservedRunningTime="2026-06-02 19:21:41.51625993 +0000 UTC m=+27.905304617" Jun 02 19:21:41.745147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.745118 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nt4k6"] Jun 02 19:21:41.745299 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.745251 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:41.745397 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:41.745378 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:41.747540 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.747520 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wls57"] Jun 02 19:21:41.747638 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:41.747622 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:41.747713 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:41.747698 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:42.491805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:42.491773 2572 generic.go:358] "Generic (PLEG): container finished" podID="805fa8c7-d03a-4984-b55a-a2eee56b71af" containerID="2ba014777ada1be38b0a377c477841f10c59632e57c563a6cb2da0d228daa39f" exitCode=0 Jun 02 19:21:42.492215 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:42.491856 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerDied","Data":"2ba014777ada1be38b0a377c477841f10c59632e57c563a6cb2da0d228daa39f"} Jun 02 19:21:43.241148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:43.241116 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:43.241148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:43.241149 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:43.241385 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:43.241222 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:43.241385 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:43.241317 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:43.780239 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:43.780063 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:43.780618 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:43.780353 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 19:21:43.780757 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:43.780703 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4x7xs" Jun 02 19:21:44.498157 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:44.498128 2572 generic.go:358] "Generic (PLEG): container finished" podID="805fa8c7-d03a-4984-b55a-a2eee56b71af" containerID="5f8f8420d840e3e73d2f3026b1768798cfd1f71048ac2657cf130cceb26e90e9" exitCode=0 Jun 02 19:21:44.498357 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:44.498223 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerDied","Data":"5f8f8420d840e3e73d2f3026b1768798cfd1f71048ac2657cf130cceb26e90e9"} Jun 02 19:21:45.241273 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:45.241235 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:45.241273 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:45.241263 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:45.242035 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:45.241389 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:45.242035 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:45.241539 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:47.241792 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.241751 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:47.242387 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.241751 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:47.242387 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:47.241914 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:21:47.242387 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:47.241962 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nt4k6" podUID="c23c6dd6-d898-4e67-8c58-cc309fc91b30" Jun 02 19:21:47.910088 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.910058 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-46.ec2.internal" event="NodeReady" Jun 02 19:21:47.910357 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.910175 2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 19:21:47.957590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.957558 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9c4jw"] Jun 02 19:21:47.986029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.985999 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:47.986211 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:47.986131 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:47.986211 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:47.986200 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:22:19.986180384 +0000 UTC m=+66.375225068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:21:47.989281 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.989257 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8dkrp"] Jun 02 19:21:47.989453 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.989434 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:47.991785 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.991749 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 19:21:47.991916 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.991844 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sz4sv\"" Jun 02 19:21:47.991916 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:47.991870 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 19:21:48.010989 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.010953 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9c4jw"] Jun 02 19:21:48.010989 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.010987 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.011153 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.010999 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8dkrp"] Jun 02 19:21:48.013539 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.013380 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 19:21:48.013539 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.013412 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 19:21:48.013868 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.013848 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bv8mp\"" Jun 02 19:21:48.013979 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.013929 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 19:21:48.086941 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.086901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af2cc218-4eaf-407a-984d-baf995c6d579-config-volume\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.086941 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.086948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlssj\" (UniqueName: \"kubernetes.io/projected/af2cc218-4eaf-407a-984d-baf995c6d579-kube-api-access-jlssj\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.087187 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.087040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.087187 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.087107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2cc218-4eaf-407a-984d-baf995c6d579-tmp-dir\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.087187 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.087152 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:48.087371 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.087270 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:21:48.087371 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.087287 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:21:48.087371 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.087296 2572 projected.go:194] Error preparing data for projected volume kube-api-access-smd79 for pod openshift-network-diagnostics/network-check-target-nt4k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:48.087371 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.087351 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79 podName:c23c6dd6-d898-4e67-8c58-cc309fc91b30 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:20.087334797 +0000 UTC m=+66.476379468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-smd79" (UniqueName: "kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79") pod "network-check-target-nt4k6" (UID: "c23c6dd6-d898-4e67-8c58-cc309fc91b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:21:48.187974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.187879 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af2cc218-4eaf-407a-984d-baf995c6d579-config-volume\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.187974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.187931 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlssj\" (UniqueName: \"kubernetes.io/projected/af2cc218-4eaf-407a-984d-baf995c6d579-kube-api-access-jlssj\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.187974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.187970 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.188256 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.188018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.188256 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.188046 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2cc218-4eaf-407a-984d-baf995c6d579-tmp-dir\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.188256 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.188100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqkqx\" (UniqueName: \"kubernetes.io/projected/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-kube-api-access-sqkqx\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.188256 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.188155 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:21:48.188256 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.188234 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:48.688213195 +0000 UTC m=+35.077257861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:21:48.188467 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.188387 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2cc218-4eaf-407a-984d-baf995c6d579-tmp-dir\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.188611 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.188580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af2cc218-4eaf-407a-984d-baf995c6d579-config-volume\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.198781 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.198753 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlssj\" (UniqueName: \"kubernetes.io/projected/af2cc218-4eaf-407a-984d-baf995c6d579-kube-api-access-jlssj\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.288805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.288767 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.289392 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.288821 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqkqx\" (UniqueName: \"kubernetes.io/projected/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-kube-api-access-sqkqx\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.289392 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.288927 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:21:48.289392 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.289028 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:48.789004089 +0000 UTC m=+35.178048777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:21:48.297325 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.297299 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqkqx\" (UniqueName: \"kubernetes.io/projected/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-kube-api-access-sqkqx\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.692567 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.692522 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:48.692749 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.692663 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:21:48.692749 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.692726 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:49.692708305 +0000 UTC m=+36.081752975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:21:48.793414 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:48.793368 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:48.793585 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.793525 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:21:48.793645 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:48.793605 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:49.793583808 +0000 UTC m=+36.182628491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:21:49.241073 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.241033 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:21:49.241267 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.241034 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:21:49.244959 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.244930 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:21:49.244959 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.244945 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:21:49.245153 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.245004 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:21:49.245153 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.245026 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9qt55\"" Jun 02 19:21:49.245153 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.245053 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tb5vh\"" Jun 02 19:21:49.699752 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.699666 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:49.700210 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:49.699832 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:21:49.700210 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:49.699930 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:51.699908067 +0000 UTC m=+38.088952753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:21:49.800339 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:49.800301 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:49.800558 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:49.800450 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:21:49.800558 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:49.800520 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:51.800500786 +0000 UTC m=+38.189545451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:21:51.513586 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:51.513392 2572 generic.go:358] "Generic (PLEG): container finished" podID="805fa8c7-d03a-4984-b55a-a2eee56b71af" containerID="739e4024dc20191c3d4a955853728ee3fd735ee3792aa2b1bf5438180b611360" exitCode=0 Jun 02 19:21:51.513929 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:51.513454 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerDied","Data":"739e4024dc20191c3d4a955853728ee3fd735ee3792aa2b1bf5438180b611360"} Jun 02 19:21:51.714762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:51.714732 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:51.714911 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:51.714893 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:21:51.714968 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:51.714958 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:55.714942509 +0000 UTC m=+42.103987174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:21:51.815762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:51.815724 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:51.815946 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:51.815875 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:21:51.816011 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:51.815957 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:21:55.815935601 +0000 UTC m=+42.204980267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:21:52.519755 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:52.519717 2572 generic.go:358] "Generic (PLEG): container finished" podID="805fa8c7-d03a-4984-b55a-a2eee56b71af" containerID="1ca8760c8b3c1925821e98264d200e21416daadb5645634049ab13fd239c9fa8" exitCode=0 Jun 02 19:21:52.520194 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:52.519775 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerDied","Data":"1ca8760c8b3c1925821e98264d200e21416daadb5645634049ab13fd239c9fa8"} Jun 02 19:21:53.524507 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:53.524475 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzd65" event={"ID":"805fa8c7-d03a-4984-b55a-a2eee56b71af","Type":"ContainerStarted","Data":"5c67c6bfdcb5017312d749ae1b903a10b4e2dbe4e0ce53217d1ba2f4eadc1a8f"} Jun 02 19:21:53.557429 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:53.557364 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nzd65" podStartSLOduration=5.783831908 podStartE2EDuration="39.557349307s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:21:16.782750741 +0000 UTC m=+3.171795408" lastFinishedPulling="2026-06-02 19:21:50.556268143 +0000 UTC m=+36.945312807" observedRunningTime="2026-06-02 19:21:53.557155644 +0000 UTC m=+39.946200324" watchObservedRunningTime="2026-06-02 19:21:53.557349307 +0000 UTC m=+39.946393993" Jun 02 19:21:55.745490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:55.745451 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:21:55.745848 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:55.745580 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:21:55.745848 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:55.745647 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:03.745629803 +0000 UTC m=+50.134674473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:21:55.846216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:21:55.846180 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:21:55.846363 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:55.846298 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:21:55.846363 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:21:55.846350 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:03.846335786 +0000 UTC m=+50.235380451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:22:03.795461 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:03.795379 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:22:03.795917 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:03.795543 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:22:03.795917 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:03.795623 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:19.795607042 +0000 UTC m=+66.184651709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:22:03.896003 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:03.895954 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:22:03.896154 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:03.896131 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:22:03.896229 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:03.896217 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:19.896194445 +0000 UTC m=+66.285239127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:22:13.510897 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:13.510870 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgp2k" Jun 02 19:22:19.796316 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:19.796260 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:22:19.796720 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:19.796407 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:22:19.796720 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:19.796492 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:51.796472296 +0000 UTC m=+98.185516968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:22:19.897685 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:19.897638 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:22:19.897825 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:19.897756 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:22:19.897825 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:19.897810 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:22:51.897793465 +0000 UTC m=+98.286838133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:22:19.998809 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:19.998764 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:22:20.001587 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.001568 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:22:20.009905 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:20.009884 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:22:20.009968 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:20.009958 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:23:24.00994082 +0000 UTC m=+130.398985485 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : secret "metrics-daemon-secret" not found Jun 02 19:22:20.099700 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.099624 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:22:20.102589 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.102569 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:22:20.112859 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.112835 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:22:20.123483 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.123443 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smd79\" (UniqueName: \"kubernetes.io/projected/c23c6dd6-d898-4e67-8c58-cc309fc91b30-kube-api-access-smd79\") pod \"network-check-target-nt4k6\" (UID: \"c23c6dd6-d898-4e67-8c58-cc309fc91b30\") " pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:22:20.160961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.160931 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9qt55\"" Jun 02 19:22:20.168884 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.168862 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:22:20.300674 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.300634 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nt4k6"] Jun 02 19:22:20.304278 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:22:20.304248 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23c6dd6_d898_4e67_8c58_cc309fc91b30.slice/crio-4131e6daa9ad48f339e1068ea470634b32140569bccfcb4e4e837365688341c1 WatchSource:0}: Error finding container 4131e6daa9ad48f339e1068ea470634b32140569bccfcb4e4e837365688341c1: Status 404 returned error can't find the container with id 4131e6daa9ad48f339e1068ea470634b32140569bccfcb4e4e837365688341c1 Jun 02 19:22:20.576822 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:20.576783 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nt4k6" event={"ID":"c23c6dd6-d898-4e67-8c58-cc309fc91b30","Type":"ContainerStarted","Data":"4131e6daa9ad48f339e1068ea470634b32140569bccfcb4e4e837365688341c1"} Jun 02 19:22:23.584871 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:23.584774 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nt4k6" event={"ID":"c23c6dd6-d898-4e67-8c58-cc309fc91b30","Type":"ContainerStarted","Data":"ae3fd73cce29111eb79a8b298c307a58875a0ccf2901c7818f1695528f5ee444"} Jun 02 19:22:23.585285 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:23.584895 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:22:23.600468 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:23.600396 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nt4k6" podStartSLOduration=66.584055514 podStartE2EDuration="1m9.600380147s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:22:20.306060879 +0000 UTC m=+66.695105544" lastFinishedPulling="2026-06-02 19:22:23.322385512 +0000 UTC m=+69.711430177" observedRunningTime="2026-06-02 19:22:23.599523289 +0000 UTC m=+69.988567985" watchObservedRunningTime="2026-06-02 19:22:23.600380147 +0000 UTC m=+69.989424834" Jun 02 19:22:51.822673 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:51.822623 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:22:51.823084 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:51.822769 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:22:51.823084 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:51.822847 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls podName:af2cc218-4eaf-407a-984d-baf995c6d579 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:55.822831813 +0000 UTC m=+162.211876478 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls") pod "dns-default-9c4jw" (UID: "af2cc218-4eaf-407a-984d-baf995c6d579") : secret "dns-default-metrics-tls" not found Jun 02 19:22:51.923480 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:51.923444 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:22:51.923595 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:51.923568 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:22:51.923636 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:22:51.923628 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert podName:4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:55.923614066 +0000 UTC m=+162.312658730 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert") pod "ingress-canary-8dkrp" (UID: "4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3") : secret "canary-serving-cert" not found Jun 02 19:22:54.590074 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:22:54.590044 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nt4k6" Jun 02 19:23:24.035262 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:24.035216 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:23:24.035780 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:24.035339 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:23:24.035780 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:24.035403 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs podName:e23bb9ac-98b9-4039-9dec-4c57e10592bc nodeName:}" failed. No retries permitted until 2026-06-02 19:25:26.03538855 +0000 UTC m=+252.424433215 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs") pod "network-metrics-daemon-wls57" (UID: "e23bb9ac-98b9-4039-9dec-4c57e10592bc") : secret "metrics-daemon-secret" not found Jun 02 19:23:30.379134 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.379094 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r"] Jun 02 19:23:30.381157 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.381134 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:30.383832 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.383812 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:23:30.384924 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.384906 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 19:23:30.385000 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.384921 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 19:23:30.385000 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.384934 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bn7z4\"" Jun 02 19:23:30.395261 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.395236 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r"] Jun 02 19:23:30.479645 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.479609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:30.479842 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.479660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qxm\" (UniqueName: \"kubernetes.io/projected/b2c3a910-7239-4b8d-9f96-207b76b3db5f-kube-api-access-68qxm\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:30.503169 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.503139 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-7kt78"] Jun 02 19:23:30.504838 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.504819 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-849c8b8c-858hk"] Jun 02 19:23:30.504977 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.504960 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.506437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.506401 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt"] Jun 02 19:23:30.506550 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.506498 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.507950 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.507932 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.519398 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.519376 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 19:23:30.524522 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.524503 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 19:23:30.524621 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.524508 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 19:23:30.525869 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.525848 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 19:23:30.525869 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.525861 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-42tmx\"" Jun 02 19:23:30.526006 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.525875 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 19:23:30.526006 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.525886 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 19:23:30.526006 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.525914 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zl7pt\"" Jun 02 19:23:30.526006 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.525925 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 19:23:30.531277 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.531260 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 19:23:30.531367 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.531351 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 19:23:30.532931 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.532914 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 19:23:30.543865 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.543843 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ckktw\"" Jun 02 19:23:30.544013 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.543993 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 19:23:30.544980 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.544956 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt"] Jun 02 19:23:30.545696 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.545675 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-7kt78"] Jun 02 19:23:30.565148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.565120 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 19:23:30.576062 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.576038 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 19:23:30.580402 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-ca-trust-extracted\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.580494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580412 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d4777232-f2dc-4ec9-a858-19b0fe75c16b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.580494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sd2l\" (UniqueName: \"kubernetes.io/projected/d4777232-f2dc-4ec9-a858-19b0fe75c16b-kube-api-access-8sd2l\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.580494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580475 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:30.580644 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-image-registry-private-configuration\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.580644 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.580644 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.580604 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:23:30.580644 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-certificates\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.580805 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.580654 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls podName:b2c3a910-7239-4b8d-9f96-207b76b3db5f nodeName:}" failed. No retries permitted until 2026-06-02 19:23:31.080639355 +0000 UTC m=+137.469684020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cjr8r" (UID: "b2c3a910-7239-4b8d-9f96-207b76b3db5f") : secret "samples-operator-tls" not found Jun 02 19:23:30.580805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580699 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwkh\" (UniqueName: \"kubernetes.io/projected/27b15327-69d9-431d-b331-9d6f1dae6888-kube-api-access-hwwkh\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.580805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27b15327-69d9-431d-b331-9d6f1dae6888-snapshots\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.580805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b15327-69d9-431d-b331-9d6f1dae6888-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.580805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580773 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68qxm\" (UniqueName: \"kubernetes.io/projected/b2c3a910-7239-4b8d-9f96-207b76b3db5f-kube-api-access-68qxm\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:30.581036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-installation-pull-secrets\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.581036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-trusted-ca\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.581036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxqz\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-kube-api-access-4hxqz\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.581036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.580947 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b15327-69d9-431d-b331-9d6f1dae6888-service-ca-bundle\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.581036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.581017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.581240 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.581056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-bound-sa-token\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.581240 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.581082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27b15327-69d9-431d-b331-9d6f1dae6888-tmp\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.581240 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.581113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27b15327-69d9-431d-b331-9d6f1dae6888-serving-cert\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.582909 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.582881 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-849c8b8c-858hk"] Jun 02 19:23:30.597232 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.597205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qxm\" (UniqueName: \"kubernetes.io/projected/b2c3a910-7239-4b8d-9f96-207b76b3db5f-kube-api-access-68qxm\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:30.597922 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.597903 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb"] Jun 02 19:23:30.599715 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.599701 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.604025 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.604008 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 19:23:30.604853 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.604830 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 19:23:30.604964 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.604850 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-247tn\"" Jun 02 19:23:30.604964 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.604830 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:23:30.604964 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.604861 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 19:23:30.615825 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.615794 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb"] Jun 02 19:23:30.682025 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.681929 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682025 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.681971 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-bound-sa-token\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682025 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.681990 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27b15327-69d9-431d-b331-9d6f1dae6888-tmp\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.682025 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682011 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27b15327-69d9-431d-b331-9d6f1dae6888-serving-cert\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682070 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-ca-trust-extracted\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.682082 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.682102 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849c8b8c-858hk: secret "image-registry-tls" not found Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.682153 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls podName:1bb27773-6cb1-4c6c-aba3-e8935f0320f4 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:31.182136807 +0000 UTC m=+137.571181472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls") pod "image-registry-849c8b8c-858hk" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4") : secret "image-registry-tls" not found Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682089 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d4777232-f2dc-4ec9-a858-19b0fe75c16b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682224 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sd2l\" (UniqueName: \"kubernetes.io/projected/d4777232-f2dc-4ec9-a858-19b0fe75c16b-kube-api-access-8sd2l\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682293 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-image-registry-private-configuration\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682317 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682358 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-certificates\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682384 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwkh\" (UniqueName: \"kubernetes.io/projected/27b15327-69d9-431d-b331-9d6f1dae6888-kube-api-access-hwwkh\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0afe9edd-04cf-491a-a38b-6174cf70fcba-config\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682446 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27b15327-69d9-431d-b331-9d6f1dae6888-tmp\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682458 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27b15327-69d9-431d-b331-9d6f1dae6888-snapshots\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.682479 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682483 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b15327-69d9-431d-b331-9d6f1dae6888-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682517 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-installation-pull-secrets\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:30.682534 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls podName:d4777232-f2dc-4ec9-a858-19b0fe75c16b nodeName:}" failed. No retries permitted until 2026-06-02 19:23:31.182518824 +0000 UTC m=+137.571563510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-njrdt" (UID: "d4777232-f2dc-4ec9-a858-19b0fe75c16b") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682539 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-ca-trust-extracted\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhdp\" (UniqueName: \"kubernetes.io/projected/0afe9edd-04cf-491a-a38b-6174cf70fcba-kube-api-access-tvhdp\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0afe9edd-04cf-491a-a38b-6174cf70fcba-serving-cert\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682657 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-trusted-ca\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682686 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxqz\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-kube-api-access-4hxqz\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.682764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.682712 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b15327-69d9-431d-b331-9d6f1dae6888-service-ca-bundle\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.683514 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.683091 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-certificates\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.683514 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.683204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27b15327-69d9-431d-b331-9d6f1dae6888-snapshots\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.683514 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.683253 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d4777232-f2dc-4ec9-a858-19b0fe75c16b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.683514 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.683304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b15327-69d9-431d-b331-9d6f1dae6888-service-ca-bundle\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.683750 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.683730 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27b15327-69d9-431d-b331-9d6f1dae6888-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.683839 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.683820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-trusted-ca\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.685056 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.685031 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27b15327-69d9-431d-b331-9d6f1dae6888-serving-cert\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.685179 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.685096 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-installation-pull-secrets\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.685401 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.685384 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-image-registry-private-configuration\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.696455 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.696412 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-bound-sa-token\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.699786 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.699760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwkh\" (UniqueName: \"kubernetes.io/projected/27b15327-69d9-431d-b331-9d6f1dae6888-kube-api-access-hwwkh\") pod \"insights-operator-788bf58df5-7kt78\" (UID: \"27b15327-69d9-431d-b331-9d6f1dae6888\") " pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.699923 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.699873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sd2l\" (UniqueName: \"kubernetes.io/projected/d4777232-f2dc-4ec9-a858-19b0fe75c16b-kube-api-access-8sd2l\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:30.700113 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.700093 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxqz\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-kube-api-access-4hxqz\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:30.784036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.783992 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0afe9edd-04cf-491a-a38b-6174cf70fcba-config\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.784036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.784043 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhdp\" (UniqueName: \"kubernetes.io/projected/0afe9edd-04cf-491a-a38b-6174cf70fcba-kube-api-access-tvhdp\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.784253 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.784063 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0afe9edd-04cf-491a-a38b-6174cf70fcba-serving-cert\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.784541 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.784515 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0afe9edd-04cf-491a-a38b-6174cf70fcba-config\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.786250 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.786232 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0afe9edd-04cf-491a-a38b-6174cf70fcba-serving-cert\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.792762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.792735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhdp\" (UniqueName: \"kubernetes.io/projected/0afe9edd-04cf-491a-a38b-6174cf70fcba-kube-api-access-tvhdp\") pod \"service-ca-operator-69877444c-ql8wb\" (UID: \"0afe9edd-04cf-491a-a38b-6174cf70fcba\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.814693 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.814670 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-7kt78" Jun 02 19:23:30.908897 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.908861 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" Jun 02 19:23:30.935997 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:30.935928 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-7kt78"] Jun 02 19:23:30.938844 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:30.938815 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b15327_69d9_431d_b331_9d6f1dae6888.slice/crio-c12193da3fd1cb86ae3188c426b859652eceedfeac36bd819e2aa65e7bc80954 WatchSource:0}: Error finding container c12193da3fd1cb86ae3188c426b859652eceedfeac36bd819e2aa65e7bc80954: Status 404 returned error can't find the container with id c12193da3fd1cb86ae3188c426b859652eceedfeac36bd819e2aa65e7bc80954 Jun 02 19:23:31.031263 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.031227 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb"] Jun 02 19:23:31.034266 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:31.034233 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afe9edd_04cf_491a_a38b_6174cf70fcba.slice/crio-7b3b33a484f875271d2c887be20b604cd37db2c4cc77718818a931f702ba835f WatchSource:0}: Error finding container 7b3b33a484f875271d2c887be20b604cd37db2c4cc77718818a931f702ba835f: Status 404 returned error can't find the container with id 7b3b33a484f875271d2c887be20b604cd37db2c4cc77718818a931f702ba835f Jun 02 19:23:31.086222 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.086180 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:31.086391 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.086334 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:23:31.086460 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.086410 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls podName:b2c3a910-7239-4b8d-9f96-207b76b3db5f nodeName:}" failed. No retries permitted until 2026-06-02 19:23:32.086390879 +0000 UTC m=+138.475435552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cjr8r" (UID: "b2c3a910-7239-4b8d-9f96-207b76b3db5f") : secret "samples-operator-tls" not found Jun 02 19:23:31.187445 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.187351 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:31.187570 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.187470 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:31.187570 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.187529 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:23:31.187570 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.187546 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849c8b8c-858hk: secret "image-registry-tls" not found Jun 02 19:23:31.187710 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.187601 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls podName:1bb27773-6cb1-4c6c-aba3-e8935f0320f4 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:32.187586958 +0000 UTC m=+138.576631623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls") pod "image-registry-849c8b8c-858hk" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4") : secret "image-registry-tls" not found Jun 02 19:23:31.187710 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.187619 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:31.187710 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:31.187671 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls podName:d4777232-f2dc-4ec9-a858-19b0fe75c16b nodeName:}" failed. No retries permitted until 2026-06-02 19:23:32.187658757 +0000 UTC m=+138.576703422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-njrdt" (UID: "d4777232-f2dc-4ec9-a858-19b0fe75c16b") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:31.703736 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.703705 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79"] Jun 02 19:23:31.705903 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.705875 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" Jun 02 19:23:31.708551 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.708522 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fhrfm\"" Jun 02 19:23:31.716233 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.716209 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79"] Jun 02 19:23:31.717200 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.717170 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-7kt78" event={"ID":"27b15327-69d9-431d-b331-9d6f1dae6888","Type":"ContainerStarted","Data":"c12193da3fd1cb86ae3188c426b859652eceedfeac36bd819e2aa65e7bc80954"} Jun 02 19:23:31.718661 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.718639 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" event={"ID":"0afe9edd-04cf-491a-a38b-6174cf70fcba","Type":"ContainerStarted","Data":"7b3b33a484f875271d2c887be20b604cd37db2c4cc77718818a931f702ba835f"} Jun 02 19:23:31.792127 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.792087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s58s8\" (UniqueName: \"kubernetes.io/projected/bb7838ff-560a-48fc-8bdb-ccf0416d9cb2-kube-api-access-s58s8\") pod \"network-check-source-56d84b9f44-g5x79\" (UID: \"bb7838ff-560a-48fc-8bdb-ccf0416d9cb2\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" Jun 02 19:23:31.893571 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.893531 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s58s8\" (UniqueName: \"kubernetes.io/projected/bb7838ff-560a-48fc-8bdb-ccf0416d9cb2-kube-api-access-s58s8\") pod \"network-check-source-56d84b9f44-g5x79\" (UID: \"bb7838ff-560a-48fc-8bdb-ccf0416d9cb2\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" Jun 02 19:23:31.903665 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:31.903622 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s58s8\" (UniqueName: \"kubernetes.io/projected/bb7838ff-560a-48fc-8bdb-ccf0416d9cb2-kube-api-access-s58s8\") pod \"network-check-source-56d84b9f44-g5x79\" (UID: \"bb7838ff-560a-48fc-8bdb-ccf0416d9cb2\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" Jun 02 19:23:32.017538 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.017501 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" Jun 02 19:23:32.095956 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.095918 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:32.096136 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.096076 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:23:32.096204 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.096164 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls podName:b2c3a910-7239-4b8d-9f96-207b76b3db5f nodeName:}" failed. No retries permitted until 2026-06-02 19:23:34.096136041 +0000 UTC m=+140.485180709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cjr8r" (UID: "b2c3a910-7239-4b8d-9f96-207b76b3db5f") : secret "samples-operator-tls" not found Jun 02 19:23:32.196871 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.196830 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:32.197056 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.196942 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:32.197056 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.197005 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:23:32.197056 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.197032 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849c8b8c-858hk: secret "image-registry-tls" not found Jun 02 19:23:32.197210 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.197076 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:32.197210 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.197101 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls podName:1bb27773-6cb1-4c6c-aba3-e8935f0320f4 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:34.197081282 +0000 UTC m=+140.586125962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls") pod "image-registry-849c8b8c-858hk" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4") : secret "image-registry-tls" not found Jun 02 19:23:32.197210 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:32.197128 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls podName:d4777232-f2dc-4ec9-a858-19b0fe75c16b nodeName:}" failed. No retries permitted until 2026-06-02 19:23:34.197112857 +0000 UTC m=+140.586157527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-njrdt" (UID: "d4777232-f2dc-4ec9-a858-19b0fe75c16b") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:32.661621 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.661588 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79"] Jun 02 19:23:32.665505 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:32.665472 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7838ff_560a_48fc_8bdb_ccf0416d9cb2.slice/crio-776e0cf57716379f35e3e03613c681aed17ffe701158e97c3a49df8f220a472c WatchSource:0}: Error finding container 776e0cf57716379f35e3e03613c681aed17ffe701158e97c3a49df8f220a472c: Status 404 returned error can't find the container with id 776e0cf57716379f35e3e03613c681aed17ffe701158e97c3a49df8f220a472c Jun 02 19:23:32.721992 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.721960 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" event={"ID":"bb7838ff-560a-48fc-8bdb-ccf0416d9cb2","Type":"ContainerStarted","Data":"776e0cf57716379f35e3e03613c681aed17ffe701158e97c3a49df8f220a472c"} Jun 02 19:23:32.723666 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.723642 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-7kt78" event={"ID":"27b15327-69d9-431d-b331-9d6f1dae6888","Type":"ContainerStarted","Data":"aa2e5ec77b8ebe3308d0d264a2f61ed5fe9317b29fb5b5dbb8d9c299cb840240"} Jun 02 19:23:32.739073 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:32.739018 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-7kt78" podStartSLOduration=1.104235621 podStartE2EDuration="2.738999961s" podCreationTimestamp="2026-06-02 19:23:30 +0000 UTC" firstStartedPulling="2026-06-02 19:23:30.940629459 +0000 UTC m=+137.329674124" lastFinishedPulling="2026-06-02 19:23:32.575393788 +0000 UTC m=+138.964438464" observedRunningTime="2026-06-02 19:23:32.738618844 +0000 UTC m=+139.127663532" watchObservedRunningTime="2026-06-02 19:23:32.738999961 +0000 UTC m=+139.128044647" Jun 02 19:23:33.727557 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:33.727461 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" event={"ID":"0afe9edd-04cf-491a-a38b-6174cf70fcba","Type":"ContainerStarted","Data":"591b8b23060602bff8375edd1e00a1ed3fd18dd595d2f67b690e21d2616b6598"} Jun 02 19:23:33.729009 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:33.728981 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" event={"ID":"bb7838ff-560a-48fc-8bdb-ccf0416d9cb2","Type":"ContainerStarted","Data":"bc45c2424574a99797f0f4250b4137fc502ff83d1ea210b4df4012d7f98d7858"} Jun 02 19:23:33.748445 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:33.745326 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" podStartSLOduration=1.308910185 podStartE2EDuration="3.745301171s" podCreationTimestamp="2026-06-02 19:23:30 +0000 UTC" firstStartedPulling="2026-06-02 19:23:31.036017499 +0000 UTC m=+137.425062164" lastFinishedPulling="2026-06-02 19:23:33.472408482 +0000 UTC m=+139.861453150" observedRunningTime="2026-06-02 19:23:33.743955491 +0000 UTC m=+140.133000179" watchObservedRunningTime="2026-06-02 19:23:33.745301171 +0000 UTC m=+140.134345859" Jun 02 19:23:33.767679 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:33.767621 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-g5x79" podStartSLOduration=2.767600339 podStartE2EDuration="2.767600339s" podCreationTimestamp="2026-06-02 19:23:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:23:33.766483832 +0000 UTC m=+140.155528521" watchObservedRunningTime="2026-06-02 19:23:33.767600339 +0000 UTC m=+140.156645027" Jun 02 19:23:34.115116 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.115077 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:34.115302 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.115235 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:23:34.115377 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.115315 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls podName:b2c3a910-7239-4b8d-9f96-207b76b3db5f nodeName:}" failed. No retries permitted until 2026-06-02 19:23:38.115294047 +0000 UTC m=+144.504338711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cjr8r" (UID: "b2c3a910-7239-4b8d-9f96-207b76b3db5f") : secret "samples-operator-tls" not found Jun 02 19:23:34.216078 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.216048 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:34.216250 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.216111 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:34.216250 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.216220 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:34.216327 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.216294 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls podName:d4777232-f2dc-4ec9-a858-19b0fe75c16b nodeName:}" failed. No retries permitted until 2026-06-02 19:23:38.216274899 +0000 UTC m=+144.605319567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-njrdt" (UID: "d4777232-f2dc-4ec9-a858-19b0fe75c16b") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:34.216327 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.216226 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:23:34.216327 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.216320 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849c8b8c-858hk: secret "image-registry-tls" not found Jun 02 19:23:34.216470 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:34.216360 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls podName:1bb27773-6cb1-4c6c-aba3-e8935f0320f4 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:38.216347665 +0000 UTC m=+144.605392330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls") pod "image-registry-849c8b8c-858hk" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4") : secret "image-registry-tls" not found Jun 02 19:23:34.906390 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.906353 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv"] Jun 02 19:23:34.909591 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.909570 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" Jun 02 19:23:34.912033 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.912011 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4r28w\"" Jun 02 19:23:34.912165 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.912036 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 19:23:34.912165 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.912050 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 19:23:34.919684 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:34.919662 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv"] Jun 02 19:23:35.020747 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:35.020709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6vz\" (UniqueName: \"kubernetes.io/projected/c4806e8d-2374-40de-9b4e-d885178e7cc1-kube-api-access-7n6vz\") pod \"migrator-96c6f749-ksldv\" (UID: \"c4806e8d-2374-40de-9b4e-d885178e7cc1\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" Jun 02 19:23:35.121745 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:35.121714 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6vz\" (UniqueName: \"kubernetes.io/projected/c4806e8d-2374-40de-9b4e-d885178e7cc1-kube-api-access-7n6vz\") pod \"migrator-96c6f749-ksldv\" (UID: \"c4806e8d-2374-40de-9b4e-d885178e7cc1\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" Jun 02 19:23:35.130911 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:35.130888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6vz\" (UniqueName: \"kubernetes.io/projected/c4806e8d-2374-40de-9b4e-d885178e7cc1-kube-api-access-7n6vz\") pod \"migrator-96c6f749-ksldv\" (UID: \"c4806e8d-2374-40de-9b4e-d885178e7cc1\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" Jun 02 19:23:35.218407 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:35.218305 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" Jun 02 19:23:35.343246 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:35.343217 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv"] Jun 02 19:23:35.346486 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:35.346448 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4806e8d_2374_40de_9b4e_d885178e7cc1.slice/crio-bdcd55d032c1e896e8967c6edc42d1aea70c7a032ba772c1a8f10fa472846c0b WatchSource:0}: Error finding container bdcd55d032c1e896e8967c6edc42d1aea70c7a032ba772c1a8f10fa472846c0b: Status 404 returned error can't find the container with id bdcd55d032c1e896e8967c6edc42d1aea70c7a032ba772c1a8f10fa472846c0b Jun 02 19:23:35.733759 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:35.733714 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" event={"ID":"c4806e8d-2374-40de-9b4e-d885178e7cc1","Type":"ContainerStarted","Data":"bdcd55d032c1e896e8967c6edc42d1aea70c7a032ba772c1a8f10fa472846c0b"} Jun 02 19:23:36.154461 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:36.154436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dghj7_a22849c8-c59f-4dca-967d-8aabec2eff68/dns-node-resolver/0.log" Jun 02 19:23:37.554918 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:37.554891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w29g5_21362d88-840e-495d-8b90-dcd5b39600f1/node-ca/0.log" Jun 02 19:23:37.740230 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:37.740197 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" event={"ID":"c4806e8d-2374-40de-9b4e-d885178e7cc1","Type":"ContainerStarted","Data":"ac5055d84aa5956f0122a71782ebc2550a9da81a2b76f1bd3bb751c9c95b5256"} Jun 02 19:23:37.740230 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:37.740235 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" event={"ID":"c4806e8d-2374-40de-9b4e-d885178e7cc1","Type":"ContainerStarted","Data":"f826cb5d2f125f5874f64e42e44bd77edbbad3d8404b2a60091b1e4461d5418b"} Jun 02 19:23:37.761125 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:37.761077 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ksldv" podStartSLOduration=2.213002569 podStartE2EDuration="3.761062371s" podCreationTimestamp="2026-06-02 19:23:34 +0000 UTC" firstStartedPulling="2026-06-02 19:23:35.348713696 +0000 UTC m=+141.737758362" lastFinishedPulling="2026-06-02 19:23:36.896773481 +0000 UTC m=+143.285818164" observedRunningTime="2026-06-02 19:23:37.759709394 +0000 UTC m=+144.148754081" watchObservedRunningTime="2026-06-02 19:23:37.761062371 +0000 UTC m=+144.150107057" Jun 02 19:23:38.145536 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:38.145498 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:38.145680 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.145650 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:23:38.145734 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.145714 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls podName:b2c3a910-7239-4b8d-9f96-207b76b3db5f nodeName:}" failed. No retries permitted until 2026-06-02 19:23:46.145697184 +0000 UTC m=+152.534741870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-cjr8r" (UID: "b2c3a910-7239-4b8d-9f96-207b76b3db5f") : secret "samples-operator-tls" not found Jun 02 19:23:38.246765 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:38.246734 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:38.246954 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:38.246845 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:38.246954 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.246873 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:23:38.246954 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.246888 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849c8b8c-858hk: secret "image-registry-tls" not found Jun 02 19:23:38.246954 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.246939 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls podName:1bb27773-6cb1-4c6c-aba3-e8935f0320f4 nodeName:}" failed. No retries permitted until 2026-06-02 19:23:46.24692477 +0000 UTC m=+152.635969435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls") pod "image-registry-849c8b8c-858hk" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4") : secret "image-registry-tls" not found Jun 02 19:23:38.246954 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.246948 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:38.247151 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:38.246998 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls podName:d4777232-f2dc-4ec9-a858-19b0fe75c16b nodeName:}" failed. No retries permitted until 2026-06-02 19:23:46.246982104 +0000 UTC m=+152.636026770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-njrdt" (UID: "d4777232-f2dc-4ec9-a858-19b0fe75c16b") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:46.214612 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.214562 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:46.216880 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.216855 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2c3a910-7239-4b8d-9f96-207b76b3db5f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-cjr8r\" (UID: \"b2c3a910-7239-4b8d-9f96-207b76b3db5f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:46.288993 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.288960 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" Jun 02 19:23:46.315589 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.315556 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:23:46.315740 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.315620 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:46.315740 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:46.315698 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:46.315855 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:46.315764 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls podName:d4777232-f2dc-4ec9-a858-19b0fe75c16b nodeName:}" failed. No retries permitted until 2026-06-02 19:24:02.31574771 +0000 UTC m=+168.704792389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-njrdt" (UID: "d4777232-f2dc-4ec9-a858-19b0fe75c16b") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:23:46.317910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.317888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"image-registry-849c8b8c-858hk\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:46.410663 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.410632 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r"] Jun 02 19:23:46.421235 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.421198 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:46.544226 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.544195 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-849c8b8c-858hk"] Jun 02 19:23:46.547342 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:46.547317 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb27773_6cb1_4c6c_aba3_e8935f0320f4.slice/crio-a542efeae4a403ea090996285a01cba8002c26db9d171cfdc14247daeec8638f WatchSource:0}: Error finding container a542efeae4a403ea090996285a01cba8002c26db9d171cfdc14247daeec8638f: Status 404 returned error can't find the container with id a542efeae4a403ea090996285a01cba8002c26db9d171cfdc14247daeec8638f Jun 02 19:23:46.763892 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.763853 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" event={"ID":"b2c3a910-7239-4b8d-9f96-207b76b3db5f","Type":"ContainerStarted","Data":"7cc1438915f7c2afcccfe33f63603ce5508038aa869db694eb0539d06fc0c6a7"} Jun 02 19:23:46.765229 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.765202 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849c8b8c-858hk" event={"ID":"1bb27773-6cb1-4c6c-aba3-e8935f0320f4","Type":"ContainerStarted","Data":"234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c"} Jun 02 19:23:46.765343 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.765234 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849c8b8c-858hk" event={"ID":"1bb27773-6cb1-4c6c-aba3-e8935f0320f4","Type":"ContainerStarted","Data":"a542efeae4a403ea090996285a01cba8002c26db9d171cfdc14247daeec8638f"} Jun 02 19:23:46.765381 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.765347 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:23:46.783504 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:46.783410 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-849c8b8c-858hk" podStartSLOduration=16.783390439 podStartE2EDuration="16.783390439s" podCreationTimestamp="2026-06-02 19:23:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:23:46.783116381 +0000 UTC m=+153.172161081" watchObservedRunningTime="2026-06-02 19:23:46.783390439 +0000 UTC m=+153.172435127" Jun 02 19:23:48.772106 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:48.772065 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" event={"ID":"b2c3a910-7239-4b8d-9f96-207b76b3db5f","Type":"ContainerStarted","Data":"a78d4d74570f35826deaa0ef028b63f7136c035aa7ffa785ac66fcb465334e60"} Jun 02 19:23:48.772106 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:48.772108 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" event={"ID":"b2c3a910-7239-4b8d-9f96-207b76b3db5f","Type":"ContainerStarted","Data":"392c73a901da4bc386f98b62d48916bfe00faafec70fd9be6ad8fd2c8eeca688"} Jun 02 19:23:48.788060 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:48.788006 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-cjr8r" podStartSLOduration=16.790445631 podStartE2EDuration="18.7879933s" podCreationTimestamp="2026-06-02 19:23:30 +0000 UTC" firstStartedPulling="2026-06-02 19:23:46.475618998 +0000 UTC m=+152.864663685" lastFinishedPulling="2026-06-02 19:23:48.473166681 +0000 UTC m=+154.862211354" observedRunningTime="2026-06-02 19:23:48.786710356 +0000 UTC m=+155.175755043" watchObservedRunningTime="2026-06-02 19:23:48.7879933 +0000 UTC m=+155.177037986" Jun 02 19:23:51.000325 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:51.000274 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9c4jw" podUID="af2cc218-4eaf-407a-984d-baf995c6d579" Jun 02 19:23:51.020224 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:51.020181 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8dkrp" podUID="4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3" Jun 02 19:23:51.781724 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:51.781696 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:23:51.781880 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:51.781706 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9c4jw" Jun 02 19:23:52.252968 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:23:52.252936 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wls57" podUID="e23bb9ac-98b9-4039-9dec-4c57e10592bc" Jun 02 19:23:55.374908 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.374877 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-849c8b8c-858hk"] Jun 02 19:23:55.406975 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.406945 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dckvk"] Jun 02 19:23:55.410452 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.410433 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.413014 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.412991 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 19:23:55.413125 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.413112 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lq9p9\"" Jun 02 19:23:55.413193 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.413128 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 19:23:55.427077 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.427055 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dckvk"] Jun 02 19:23:55.488732 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.488697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-crio-socket\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.488895 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.488742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g4c6\" (UniqueName: \"kubernetes.io/projected/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-kube-api-access-6g4c6\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.488895 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.488833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.488967 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.488901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.488967 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.488937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-data-volume\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.589731 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.589687 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6g4c6\" (UniqueName: \"kubernetes.io/projected/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-kube-api-access-6g4c6\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.589926 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.589757 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.589926 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.589802 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.589926 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.589838 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-data-volume\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.590073 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.589959 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-crio-socket\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.590073 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.590044 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-crio-socket\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.590176 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.590161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-data-volume\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.590474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.590452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.592104 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.592087 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.600552 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.600530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g4c6\" (UniqueName: \"kubernetes.io/projected/5c11a8f9-dd13-4c58-8e5a-6bb0990293d9-kube-api-access-6g4c6\") pod \"insights-runtime-extractor-dckvk\" (UID: \"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9\") " pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.719828 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.719741 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dckvk" Jun 02 19:23:55.858458 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.858412 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dckvk"] Jun 02 19:23:55.861691 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:55.861664 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c11a8f9_dd13_4c58_8e5a_6bb0990293d9.slice/crio-f22f394d6a816671c315ddc16037ff38a2f1fba6a8e55081cd6f1d68670a01e7 WatchSource:0}: Error finding container f22f394d6a816671c315ddc16037ff38a2f1fba6a8e55081cd6f1d68670a01e7: Status 404 returned error can't find the container with id f22f394d6a816671c315ddc16037ff38a2f1fba6a8e55081cd6f1d68670a01e7 Jun 02 19:23:55.893054 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.893008 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:23:55.895289 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.895271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af2cc218-4eaf-407a-984d-baf995c6d579-metrics-tls\") pod \"dns-default-9c4jw\" (UID: \"af2cc218-4eaf-407a-984d-baf995c6d579\") " pod="openshift-dns/dns-default-9c4jw" Jun 02 19:23:55.984963 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.984890 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sz4sv\"" Jun 02 19:23:55.993107 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.993081 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9c4jw" Jun 02 19:23:55.993386 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.993366 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:23:55.995685 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:55.995666 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3-cert\") pod \"ingress-canary-8dkrp\" (UID: \"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3\") " pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:23:56.113868 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.113837 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9c4jw"] Jun 02 19:23:56.116538 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:56.116510 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2cc218_4eaf_407a_984d_baf995c6d579.slice/crio-c57013e23d7412c46a5a20bb1bfe493dd0c685962a831a2ad081fa31fcd6b4cd WatchSource:0}: Error finding container c57013e23d7412c46a5a20bb1bfe493dd0c685962a831a2ad081fa31fcd6b4cd: Status 404 returned error can't find the container with id c57013e23d7412c46a5a20bb1bfe493dd0c685962a831a2ad081fa31fcd6b4cd Jun 02 19:23:56.285206 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.285179 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bv8mp\"" Jun 02 19:23:56.293166 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.293147 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dkrp" Jun 02 19:23:56.414679 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.414636 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8dkrp"] Jun 02 19:23:56.417648 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:23:56.417623 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4bd9c7_90df_498e_9e13_aa8ec3c3d7a3.slice/crio-355642e67590345b5e898dee6c97eaea7ca8dbbfb5461f1209c6a998f6d8fb47 WatchSource:0}: Error finding container 355642e67590345b5e898dee6c97eaea7ca8dbbfb5461f1209c6a998f6d8fb47: Status 404 returned error can't find the container with id 355642e67590345b5e898dee6c97eaea7ca8dbbfb5461f1209c6a998f6d8fb47 Jun 02 19:23:56.796859 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.796814 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8dkrp" event={"ID":"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3","Type":"ContainerStarted","Data":"355642e67590345b5e898dee6c97eaea7ca8dbbfb5461f1209c6a998f6d8fb47"} Jun 02 19:23:56.797961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.797925 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9c4jw" event={"ID":"af2cc218-4eaf-407a-984d-baf995c6d579","Type":"ContainerStarted","Data":"c57013e23d7412c46a5a20bb1bfe493dd0c685962a831a2ad081fa31fcd6b4cd"} Jun 02 19:23:56.799685 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.799660 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dckvk" event={"ID":"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9","Type":"ContainerStarted","Data":"037b587f1297274b4d4ffd9fce5837006048489562bbdb716e1ab5044fb429f6"} Jun 02 19:23:56.799796 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.799691 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dckvk" event={"ID":"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9","Type":"ContainerStarted","Data":"0d3e664ca52c1b17c7c79b61f6f78bc192d08281192ac47e13b9b969f0ed35bd"} Jun 02 19:23:56.799796 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:56.799705 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dckvk" event={"ID":"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9","Type":"ContainerStarted","Data":"f22f394d6a816671c315ddc16037ff38a2f1fba6a8e55081cd6f1d68670a01e7"} Jun 02 19:23:57.804619 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:57.804578 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9c4jw" event={"ID":"af2cc218-4eaf-407a-984d-baf995c6d579","Type":"ContainerStarted","Data":"27e802e9cfad953918afae969d56acc23830b1eea91b6b4ac5bcdaa09af5829d"} Jun 02 19:23:57.804619 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:57.804621 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9c4jw" event={"ID":"af2cc218-4eaf-407a-984d-baf995c6d579","Type":"ContainerStarted","Data":"3c4705d049bcfb7b210e476fe7cb2e540ddbd1df266849340adfe23a391aac6f"} Jun 02 19:23:57.805145 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:57.804724 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9c4jw" Jun 02 19:23:57.822040 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:57.821983 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9c4jw" podStartSLOduration=129.578349754 podStartE2EDuration="2m10.821963425s" podCreationTimestamp="2026-06-02 19:21:47 +0000 UTC" firstStartedPulling="2026-06-02 19:23:56.118293453 +0000 UTC m=+162.507338130" lastFinishedPulling="2026-06-02 19:23:57.361907116 +0000 UTC m=+163.750951801" observedRunningTime="2026-06-02 19:23:57.821087054 +0000 UTC m=+164.210131743" watchObservedRunningTime="2026-06-02 19:23:57.821963425 +0000 UTC m=+164.211008116" Jun 02 19:23:58.808196 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:58.808153 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8dkrp" event={"ID":"4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3","Type":"ContainerStarted","Data":"fc7d30d2ee08fe380b224f2c834256ca58ff0d9f65a1f58591f09bfbba73146b"} Jun 02 19:23:58.810104 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:58.810076 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dckvk" event={"ID":"5c11a8f9-dd13-4c58-8e5a-6bb0990293d9","Type":"ContainerStarted","Data":"0aeeda7b81cab87fbf213889bcadcc2a5795920453f87e911bde974a0d3cd427"} Jun 02 19:23:58.825571 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:58.825517 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8dkrp" podStartSLOduration=129.619929115 podStartE2EDuration="2m11.825500416s" podCreationTimestamp="2026-06-02 19:21:47 +0000 UTC" firstStartedPulling="2026-06-02 19:23:56.419556809 +0000 UTC m=+162.808601473" lastFinishedPulling="2026-06-02 19:23:58.62512811 +0000 UTC m=+165.014172774" observedRunningTime="2026-06-02 19:23:58.823698044 +0000 UTC m=+165.212742731" watchObservedRunningTime="2026-06-02 19:23:58.825500416 +0000 UTC m=+165.214545104" Jun 02 19:23:58.841095 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:23:58.841034 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dckvk" podStartSLOduration=1.133817167 podStartE2EDuration="3.841015266s" podCreationTimestamp="2026-06-02 19:23:55 +0000 UTC" firstStartedPulling="2026-06-02 19:23:55.919125144 +0000 UTC m=+162.308169815" lastFinishedPulling="2026-06-02 19:23:58.626323249 +0000 UTC m=+165.015367914" observedRunningTime="2026-06-02 19:23:58.840227856 +0000 UTC m=+165.229272568" watchObservedRunningTime="2026-06-02 19:23:58.841015266 +0000 UTC m=+165.230059953" Jun 02 19:24:02.342040 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:02.341957 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:24:02.344291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:02.344271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4777232-f2dc-4ec9-a858-19b0fe75c16b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-njrdt\" (UID: \"d4777232-f2dc-4ec9-a858-19b0fe75c16b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:24:02.625166 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:02.625065 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" Jun 02 19:24:02.748440 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:02.748386 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt"] Jun 02 19:24:02.751630 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:24:02.751602 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4777232_f2dc_4ec9_a858_19b0fe75c16b.slice/crio-cdaece50f393aed8138eab62ef24adc84bbbc63153cf5ace21f9b7f7b1f65a83 WatchSource:0}: Error finding container cdaece50f393aed8138eab62ef24adc84bbbc63153cf5ace21f9b7f7b1f65a83: Status 404 returned error can't find the container with id cdaece50f393aed8138eab62ef24adc84bbbc63153cf5ace21f9b7f7b1f65a83 Jun 02 19:24:02.821801 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:02.821758 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" event={"ID":"d4777232-f2dc-4ec9-a858-19b0fe75c16b","Type":"ContainerStarted","Data":"cdaece50f393aed8138eab62ef24adc84bbbc63153cf5ace21f9b7f7b1f65a83"} Jun 02 19:24:04.827999 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:04.827962 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" event={"ID":"d4777232-f2dc-4ec9-a858-19b0fe75c16b","Type":"ContainerStarted","Data":"6d332695a9ee34019f30a08201eebe9113d3a43bdee7de5508df552d4d535796"} Jun 02 19:24:04.844066 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:04.844009 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-njrdt" podStartSLOduration=32.992924832 podStartE2EDuration="34.843993472s" podCreationTimestamp="2026-06-02 19:23:30 +0000 UTC" firstStartedPulling="2026-06-02 19:24:02.753448603 +0000 UTC m=+169.142493271" lastFinishedPulling="2026-06-02 19:24:04.604517245 +0000 UTC m=+170.993561911" observedRunningTime="2026-06-02 19:24:04.84354192 +0000 UTC m=+171.232586607" watchObservedRunningTime="2026-06-02 19:24:04.843993472 +0000 UTC m=+171.233038159" Jun 02 19:24:05.102048 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.102009 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h"] Jun 02 19:24:05.105054 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.105036 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:05.107565 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.107542 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 19:24:05.107648 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.107580 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hpcsg\"" Jun 02 19:24:05.112543 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.112515 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h"] Jun 02 19:24:05.162987 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.162952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d7e4cf5f-f226-4620-907b-a83128a3753a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9kw8h\" (UID: \"d7e4cf5f-f226-4620-907b-a83128a3753a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:05.241453 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.241400 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:24:05.264018 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.263988 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d7e4cf5f-f226-4620-907b-a83128a3753a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9kw8h\" (UID: \"d7e4cf5f-f226-4620-907b-a83128a3753a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:05.266317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.266292 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d7e4cf5f-f226-4620-907b-a83128a3753a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9kw8h\" (UID: \"d7e4cf5f-f226-4620-907b-a83128a3753a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:05.380547 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.380472 2572 patch_prober.go:28] interesting pod/image-registry-849c8b8c-858hk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 19:24:05.380547 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.380523 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-849c8b8c-858hk" podUID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 19:24:05.415779 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.415755 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:05.539187 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.539133 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h"] Jun 02 19:24:05.541992 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:24:05.541960 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e4cf5f_f226_4620_907b_a83128a3753a.slice/crio-f4439fcd5e759c47a575ffc16d297c90e8e27773e2e49ea1dfc957b9843c004c WatchSource:0}: Error finding container f4439fcd5e759c47a575ffc16d297c90e8e27773e2e49ea1dfc957b9843c004c: Status 404 returned error can't find the container with id f4439fcd5e759c47a575ffc16d297c90e8e27773e2e49ea1dfc957b9843c004c Jun 02 19:24:05.830865 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:05.830835 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" event={"ID":"d7e4cf5f-f226-4620-907b-a83128a3753a","Type":"ContainerStarted","Data":"f4439fcd5e759c47a575ffc16d297c90e8e27773e2e49ea1dfc957b9843c004c"} Jun 02 19:24:06.834883 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:06.834850 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" event={"ID":"d7e4cf5f-f226-4620-907b-a83128a3753a","Type":"ContainerStarted","Data":"b72e299fe8955038b49b0bb0821b41911cbe13ada288eb56ec4558c5605c5c8d"} Jun 02 19:24:06.835210 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:06.835053 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:06.836494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:06.836401 2572 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-59b7f8756b-9kw8h container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.15:8443/healthz\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 02 19:24:06.836494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:06.836478 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" podUID="d7e4cf5f-f226-4620-907b-a83128a3753a" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.134.0.15:8443/healthz\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 02 19:24:06.852499 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:06.852444 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" podStartSLOduration=0.6280191 podStartE2EDuration="1.852411179s" podCreationTimestamp="2026-06-02 19:24:05 +0000 UTC" firstStartedPulling="2026-06-02 19:24:05.543763051 +0000 UTC m=+171.932807717" lastFinishedPulling="2026-06-02 19:24:06.76815513 +0000 UTC m=+173.157199796" observedRunningTime="2026-06-02 19:24:06.851066609 +0000 UTC m=+173.240111296" watchObservedRunningTime="2026-06-02 19:24:06.852411179 +0000 UTC m=+173.241455867" Jun 02 19:24:07.812759 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:07.812730 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9c4jw" Jun 02 19:24:07.840845 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:07.840812 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9kw8h" Jun 02 19:24:08.177224 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.177139 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn"] Jun 02 19:24:08.206339 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.206306 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn"] Jun 02 19:24:08.206500 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.206354 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.208981 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.208958 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 19:24:08.209110 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.209052 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 19:24:08.209110 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.209067 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-psqqs\"" Jun 02 19:24:08.209203 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.209166 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 19:24:08.289286 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.289241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7255256b-4bde-4951-86e5-cdc5a2b1e173-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.289286 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.289293 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7255256b-4bde-4951-86e5-cdc5a2b1e173-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.289543 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.289361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7255256b-4bde-4951-86e5-cdc5a2b1e173-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.289543 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.289397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5w8l\" (UniqueName: \"kubernetes.io/projected/7255256b-4bde-4951-86e5-cdc5a2b1e173-kube-api-access-b5w8l\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.390372 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.390335 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7255256b-4bde-4951-86e5-cdc5a2b1e173-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.390372 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.390375 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7255256b-4bde-4951-86e5-cdc5a2b1e173-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.390631 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.390398 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7255256b-4bde-4951-86e5-cdc5a2b1e173-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.390631 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.390439 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5w8l\" (UniqueName: \"kubernetes.io/projected/7255256b-4bde-4951-86e5-cdc5a2b1e173-kube-api-access-b5w8l\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.391156 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.391133 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7255256b-4bde-4951-86e5-cdc5a2b1e173-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.392830 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.392807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7255256b-4bde-4951-86e5-cdc5a2b1e173-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.392830 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.392824 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7255256b-4bde-4951-86e5-cdc5a2b1e173-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.398681 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.398652 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5w8l\" (UniqueName: \"kubernetes.io/projected/7255256b-4bde-4951-86e5-cdc5a2b1e173-kube-api-access-b5w8l\") pod \"prometheus-operator-658bcd8bdf-qvdxn\" (UID: \"7255256b-4bde-4951-86e5-cdc5a2b1e173\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.515362 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.515324 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" Jun 02 19:24:08.640054 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.640022 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn"] Jun 02 19:24:08.643094 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:24:08.643067 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7255256b_4bde_4951_86e5_cdc5a2b1e173.slice/crio-43c9a93582fc7ac6ee5fbaa42fe3a2c778bb81fbf3d3f766dcfa9a9e6d85dd38 WatchSource:0}: Error finding container 43c9a93582fc7ac6ee5fbaa42fe3a2c778bb81fbf3d3f766dcfa9a9e6d85dd38: Status 404 returned error can't find the container with id 43c9a93582fc7ac6ee5fbaa42fe3a2c778bb81fbf3d3f766dcfa9a9e6d85dd38 Jun 02 19:24:08.840958 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:08.840871 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" event={"ID":"7255256b-4bde-4951-86e5-cdc5a2b1e173","Type":"ContainerStarted","Data":"43c9a93582fc7ac6ee5fbaa42fe3a2c778bb81fbf3d3f766dcfa9a9e6d85dd38"} Jun 02 19:24:10.846963 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:10.846921 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" event={"ID":"7255256b-4bde-4951-86e5-cdc5a2b1e173","Type":"ContainerStarted","Data":"84c680e5bca69321c7444b2ac1b7a5d4081ab27f605437bc4352f3fee91b14e4"} Jun 02 19:24:10.847332 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:10.846970 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" event={"ID":"7255256b-4bde-4951-86e5-cdc5a2b1e173","Type":"ContainerStarted","Data":"b124599e0ed517f6c169fd98e8197fe770c26819a8d6a900fb9f29ce6da9957c"} Jun 02 19:24:10.863983 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:10.863932 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qvdxn" podStartSLOduration=1.53901036 podStartE2EDuration="2.863918257s" podCreationTimestamp="2026-06-02 19:24:08 +0000 UTC" firstStartedPulling="2026-06-02 19:24:08.644843275 +0000 UTC m=+175.033887944" lastFinishedPulling="2026-06-02 19:24:09.969751177 +0000 UTC m=+176.358795841" observedRunningTime="2026-06-02 19:24:10.863475868 +0000 UTC m=+177.252520552" watchObservedRunningTime="2026-06-02 19:24:10.863918257 +0000 UTC m=+177.252962944" Jun 02 19:24:12.538966 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.538930 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-9nm68"] Jun 02 19:24:12.541260 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.541239 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.543749 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.543726 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 19:24:12.543844 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.543751 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 19:24:12.544751 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.544731 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 19:24:12.544852 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.544762 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ngfqh\"" Jun 02 19:24:12.545919 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.545900 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-smm4w"] Jun 02 19:24:12.548113 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.548088 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.550276 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.550260 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 19:24:12.550429 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.550397 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 19:24:12.550490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.550477 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 19:24:12.550537 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.550496 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4xbr5\"" Jun 02 19:24:12.553527 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.553509 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-9nm68"] Jun 02 19:24:12.626568 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-sys\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.626720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-tls\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a720788-d5b9-4c82-a1a6-af070cf2f574-metrics-client-ca\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626854 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-wtmp\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626854 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825bcd1e-1a91-42f6-862b-efddd97ec99a-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.626854 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-accelerators-collector-config\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626854 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/825bcd1e-1a91-42f6-862b-efddd97ec99a-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.626970 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.626970 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-textfile\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626970 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.626970 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-root\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.626970 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.626961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msksx\" (UniqueName: \"kubernetes.io/projected/8a720788-d5b9-4c82-a1a6-af070cf2f574-kube-api-access-msksx\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.627120 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.627008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspcg\" (UniqueName: \"kubernetes.io/projected/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-api-access-mspcg\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.727887 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.727855 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728058 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.727915 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-tls\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728058 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.727943 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a720788-d5b9-4c82-a1a6-af070cf2f574-metrics-client-ca\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728058 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.727981 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-wtmp\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728192 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:24:12.728105 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 19:24:12.728192 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-wtmp\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728192 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:24:12.728185 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-tls podName:8a720788-d5b9-4c82-a1a6-af070cf2f574 nodeName:}" failed. No retries permitted until 2026-06-02 19:24:13.228163227 +0000 UTC m=+179.617207897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-tls") pod "node-exporter-smm4w" (UID: "8a720788-d5b9-4c82-a1a6-af070cf2f574") : secret "node-exporter-tls" not found Jun 02 19:24:12.728304 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728212 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825bcd1e-1a91-42f6-862b-efddd97ec99a-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728304 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728246 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-accelerators-collector-config\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728304 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728279 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/825bcd1e-1a91-42f6-862b-efddd97ec99a-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728460 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728302 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728460 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728331 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-textfile\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728460 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728376 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728460 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728402 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-root\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728460 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728453 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msksx\" (UniqueName: \"kubernetes.io/projected/8a720788-d5b9-4c82-a1a6-af070cf2f574-kube-api-access-msksx\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728708 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728491 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mspcg\" (UniqueName: \"kubernetes.io/projected/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-api-access-mspcg\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728708 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728524 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-sys\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728708 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728553 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728855 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/825bcd1e-1a91-42f6-862b-efddd97ec99a-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.728855 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728790 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-root\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728956 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-accelerators-collector-config\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.728956 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728872 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a720788-d5b9-4c82-a1a6-af070cf2f574-metrics-client-ca\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.729067 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.728984 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a720788-d5b9-4c82-a1a6-af070cf2f574-sys\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.729179 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.729159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-textfile\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.729236 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.729172 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.729434 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.729394 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825bcd1e-1a91-42f6-862b-efddd97ec99a-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.730747 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.730719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.731034 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.731019 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.731231 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.731211 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.739789 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.739764 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msksx\" (UniqueName: \"kubernetes.io/projected/8a720788-d5b9-4c82-a1a6-af070cf2f574-kube-api-access-msksx\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:12.739872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.739803 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspcg\" (UniqueName: \"kubernetes.io/projected/825bcd1e-1a91-42f6-862b-efddd97ec99a-kube-api-access-mspcg\") pod \"kube-state-metrics-8469c486bb-9nm68\" (UID: \"825bcd1e-1a91-42f6-862b-efddd97ec99a\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.850631 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.850553 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" Jun 02 19:24:12.975932 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:12.975899 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-9nm68"] Jun 02 19:24:12.979020 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:24:12.978995 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825bcd1e_1a91_42f6_862b_efddd97ec99a.slice/crio-d14232d7b30a97a1b9d573064503752d56ab51d4735d80a952ddec664d022472 WatchSource:0}: Error finding container d14232d7b30a97a1b9d573064503752d56ab51d4735d80a952ddec664d022472: Status 404 returned error can't find the container with id d14232d7b30a97a1b9d573064503752d56ab51d4735d80a952ddec664d022472 Jun 02 19:24:13.233397 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:13.233316 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-tls\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:13.235643 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:13.235622 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a720788-d5b9-4c82-a1a6-af070cf2f574-node-exporter-tls\") pod \"node-exporter-smm4w\" (UID: \"8a720788-d5b9-4c82-a1a6-af070cf2f574\") " pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:13.457882 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:13.457842 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-smm4w" Jun 02 19:24:13.470117 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:24:13.470083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a720788_d5b9_4c82_a1a6_af070cf2f574.slice/crio-214b329fcf60900b2bff756631d78a65d7bb73a713ddb91fb1b204414d7643c3 WatchSource:0}: Error finding container 214b329fcf60900b2bff756631d78a65d7bb73a713ddb91fb1b204414d7643c3: Status 404 returned error can't find the container with id 214b329fcf60900b2bff756631d78a65d7bb73a713ddb91fb1b204414d7643c3 Jun 02 19:24:13.855995 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:13.855959 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smm4w" event={"ID":"8a720788-d5b9-4c82-a1a6-af070cf2f574","Type":"ContainerStarted","Data":"214b329fcf60900b2bff756631d78a65d7bb73a713ddb91fb1b204414d7643c3"} Jun 02 19:24:13.857034 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:13.857013 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" event={"ID":"825bcd1e-1a91-42f6-862b-efddd97ec99a","Type":"ContainerStarted","Data":"d14232d7b30a97a1b9d573064503752d56ab51d4735d80a952ddec664d022472"} Jun 02 19:24:14.862715 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:14.862664 2572 generic.go:358] "Generic (PLEG): container finished" podID="8a720788-d5b9-4c82-a1a6-af070cf2f574" containerID="e3cc3af5b453e5546fc5409c5ac3b7154378f01902ca9010cb4c2073e583a23a" exitCode=0 Jun 02 19:24:14.863159 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:14.862708 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smm4w" event={"ID":"8a720788-d5b9-4c82-a1a6-af070cf2f574","Type":"ContainerDied","Data":"e3cc3af5b453e5546fc5409c5ac3b7154378f01902ca9010cb4c2073e583a23a"} Jun 02 19:24:14.865163 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:14.865126 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" event={"ID":"825bcd1e-1a91-42f6-862b-efddd97ec99a","Type":"ContainerStarted","Data":"7e2fd1f8acda6921e805d0e18ca93fe30d5eaa7fc059c1c4104e777a21b7ff79"} Jun 02 19:24:14.865163 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:14.865160 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" event={"ID":"825bcd1e-1a91-42f6-862b-efddd97ec99a","Type":"ContainerStarted","Data":"d55c94a9567db022432b3abc86a65869540942debdeb7753d50ea088934e67c0"} Jun 02 19:24:14.865345 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:14.865175 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" event={"ID":"825bcd1e-1a91-42f6-862b-efddd97ec99a","Type":"ContainerStarted","Data":"48ccff93316874049faa3f0f76843de6baf0c84ad4e7e91967cf50f30d141e25"} Jun 02 19:24:14.900044 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:14.899990 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-9nm68" podStartSLOduration=1.318547129 podStartE2EDuration="2.89997159s" podCreationTimestamp="2026-06-02 19:24:12 +0000 UTC" firstStartedPulling="2026-06-02 19:24:12.980952168 +0000 UTC m=+179.369996834" lastFinishedPulling="2026-06-02 19:24:14.562376623 +0000 UTC m=+180.951421295" observedRunningTime="2026-06-02 19:24:14.899775941 +0000 UTC m=+181.288820630" watchObservedRunningTime="2026-06-02 19:24:14.89997159 +0000 UTC m=+181.289016277" Jun 02 19:24:15.379834 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:15.379805 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:24:15.869377 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:15.869338 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smm4w" event={"ID":"8a720788-d5b9-4c82-a1a6-af070cf2f574","Type":"ContainerStarted","Data":"26a3a6c7ca1fffba108f0a7ae00794329d098e9039fecc4a635e9f8b6308072f"} Jun 02 19:24:15.869377 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:15.869382 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-smm4w" event={"ID":"8a720788-d5b9-4c82-a1a6-af070cf2f574","Type":"ContainerStarted","Data":"891468e3b3b8d55e4171c7074c1277ed35a2f32f78bc3c8f67105d3f1ed2e965"} Jun 02 19:24:15.894959 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:15.894896 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-smm4w" podStartSLOduration=2.803466514 podStartE2EDuration="3.894877501s" podCreationTimestamp="2026-06-02 19:24:12 +0000 UTC" firstStartedPulling="2026-06-02 19:24:13.471966103 +0000 UTC m=+179.861010771" lastFinishedPulling="2026-06-02 19:24:14.563377076 +0000 UTC m=+180.952421758" observedRunningTime="2026-06-02 19:24:15.894501234 +0000 UTC m=+182.283545925" watchObservedRunningTime="2026-06-02 19:24:15.894877501 +0000 UTC m=+182.283922190" Jun 02 19:24:17.308197 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.308156 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt"] Jun 02 19:24:17.311980 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.311957 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:17.314250 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.314222 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 19:24:17.314250 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.314235 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-fkzjj\"" Jun 02 19:24:17.317635 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.317610 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt"] Jun 02 19:24:17.467049 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.467009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a67e591f-40fa-4af6-a03a-528d0cfba948-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w2gzt\" (UID: \"a67e591f-40fa-4af6-a03a-528d0cfba948\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:17.567744 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:17.567655 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a67e591f-40fa-4af6-a03a-528d0cfba948-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w2gzt\" (UID: \"a67e591f-40fa-4af6-a03a-528d0cfba948\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:17.567881 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:24:17.567797 2572 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 19:24:17.567881 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:24:17.567857 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a67e591f-40fa-4af6-a03a-528d0cfba948-monitoring-plugin-cert podName:a67e591f-40fa-4af6-a03a-528d0cfba948 nodeName:}" failed. No retries permitted until 2026-06-02 19:24:18.067843832 +0000 UTC m=+184.456888501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a67e591f-40fa-4af6-a03a-528d0cfba948-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-w2gzt" (UID: "a67e591f-40fa-4af6-a03a-528d0cfba948") : secret "monitoring-plugin-cert" not found Jun 02 19:24:18.072300 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.072266 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a67e591f-40fa-4af6-a03a-528d0cfba948-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w2gzt\" (UID: \"a67e591f-40fa-4af6-a03a-528d0cfba948\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:18.074674 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.074644 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a67e591f-40fa-4af6-a03a-528d0cfba948-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-w2gzt\" (UID: \"a67e591f-40fa-4af6-a03a-528d0cfba948\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:18.222025 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.221990 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:18.347007 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.346931 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt"] Jun 02 19:24:18.349964 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:24:18.349936 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67e591f_40fa_4af6_a03a_528d0cfba948.slice/crio-137cd18dc488f047df236ffd0d53ae420e07a1c6ae098198a869d107cbc748e4 WatchSource:0}: Error finding container 137cd18dc488f047df236ffd0d53ae420e07a1c6ae098198a869d107cbc748e4: Status 404 returned error can't find the container with id 137cd18dc488f047df236ffd0d53ae420e07a1c6ae098198a869d107cbc748e4 Jun 02 19:24:18.768785 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.768750 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:24:18.774088 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.774063 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.776770 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.776735 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 19:24:18.776918 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.776808 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 19:24:18.776918 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.776824 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 19:24:18.776918 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.776743 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 19:24:18.776918 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.776832 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 19:24:18.777832 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.777812 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1sg17diep8s1t\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.777961 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.778010 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.777888 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.777963 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.777848 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.777945 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 19:24:18.778259 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.778252 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9p2lr\"" Jun 02 19:24:18.778787 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.778313 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 19:24:18.780627 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.780605 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 19:24:18.784989 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.784965 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpc2k\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-kube-api-access-wpc2k\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.879985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.880026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.880055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.881474 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.880093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.882295 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.880135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.882295 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.880164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.883545 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.883177 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" event={"ID":"a67e591f-40fa-4af6-a03a-528d0cfba948","Type":"ContainerStarted","Data":"137cd18dc488f047df236ffd0d53ae420e07a1c6ae098198a869d107cbc748e4"} Jun 02 19:24:18.980720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.980683 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.980720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.980722 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.980954 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.980744 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.980954 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.980891 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.980954 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.980941 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981109 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.980985 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981109 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981037 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981121 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981121 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981148 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981183 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981216 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981213 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpc2k\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-kube-api-access-wpc2k\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981245 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981296 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981333 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.981489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.981359 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.982642 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.982029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.982642 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.982566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.982846 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.982820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.983446 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.983232 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.983446 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.983279 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.983446 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.983314 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.984534 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.984510 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.985681 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.985521 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.985842 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.985620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.986592 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.986195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.986724 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.986439 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.986846 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.986530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.986956 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.986868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.988029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.987337 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.988334 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.988310 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.988672 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.988645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.988981 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.988961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.989515 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.989496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.989802 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.989783 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:18.991302 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:18.991283 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpc2k\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-kube-api-access-wpc2k\") pod \"prometheus-k8s-0\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:19.087735 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:19.087647 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:19.239659 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:19.239622 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:24:19.888074 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:19.888031 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"4944532784f486014744eafe1c6efea012c4a2f654de1ef44cf073d377df7c77"} Jun 02 19:24:20.393663 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.393613 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-849c8b8c-858hk" podUID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" containerName="registry" containerID="cri-o://234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c" gracePeriod=30 Jun 02 19:24:20.777121 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.777091 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:24:20.891468 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.891431 2572 generic.go:358] "Generic (PLEG): container finished" podID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" containerID="234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c" exitCode=0 Jun 02 19:24:20.891468 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.891459 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849c8b8c-858hk" event={"ID":"1bb27773-6cb1-4c6c-aba3-e8935f0320f4","Type":"ContainerDied","Data":"234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c"} Jun 02 19:24:20.891926 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.891485 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849c8b8c-858hk" Jun 02 19:24:20.891926 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.891499 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849c8b8c-858hk" event={"ID":"1bb27773-6cb1-4c6c-aba3-e8935f0320f4","Type":"ContainerDied","Data":"a542efeae4a403ea090996285a01cba8002c26db9d171cfdc14247daeec8638f"} Jun 02 19:24:20.891926 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.891521 2572 scope.go:117] "RemoveContainer" containerID="234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c" Jun 02 19:24:20.893083 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.893047 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" event={"ID":"a67e591f-40fa-4af6-a03a-528d0cfba948","Type":"ContainerStarted","Data":"0ddd5c72e53bab4c39c5768ee3cae7467d778b56269d617ce2eb961d49333645"} Jun 02 19:24:20.893255 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.893225 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:20.895189 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.895167 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" exitCode=0 Jun 02 19:24:20.895295 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.895258 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} Jun 02 19:24:20.899902 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.899880 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" Jun 02 19:24:20.901812 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.901789 2572 scope.go:117] "RemoveContainer" containerID="234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c" Jun 02 19:24:20.902084 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:24:20.902052 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c\": container with ID starting with 234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c not found: ID does not exist" containerID="234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c" Jun 02 19:24:20.902157 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902082 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-certificates\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902157 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902095 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c"} err="failed to get container status \"234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c\": rpc error: code = NotFound desc = could not find container \"234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c\": container with ID starting with 234f6195f28b9a1afb8f7dfa40782689407691ea2ccdd3fa9d9e36860cb32d4c not found: ID does not exist" Jun 02 19:24:20.902157 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902127 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-ca-trust-extracted\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902327 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902169 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902327 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902196 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hxqz\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-kube-api-access-4hxqz\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902327 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902239 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-trusted-ca\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902491 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902367 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-installation-pull-secrets\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902491 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902448 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-image-registry-private-configuration\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902491 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902480 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-bound-sa-token\") pod \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\" (UID: \"1bb27773-6cb1-4c6c-aba3-e8935f0320f4\") " Jun 02 19:24:20.902638 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902574 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:24:20.903284 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.902758 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-certificates\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:20.905057 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.905026 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-kube-api-access-4hxqz" (OuterVolumeSpecName: "kube-api-access-4hxqz") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "kube-api-access-4hxqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:24:20.905153 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.905074 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:24:20.905351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.905327 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:24:20.905444 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.905383 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:24:20.905500 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.905440 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:24:20.905706 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.905678 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:24:20.911011 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.910989 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1bb27773-6cb1-4c6c-aba3-e8935f0320f4" (UID: "1bb27773-6cb1-4c6c-aba3-e8935f0320f4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:24:20.950342 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:20.950291 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-w2gzt" podStartSLOduration=1.708792183 podStartE2EDuration="3.950276338s" podCreationTimestamp="2026-06-02 19:24:17 +0000 UTC" firstStartedPulling="2026-06-02 19:24:18.351725858 +0000 UTC m=+184.740770524" lastFinishedPulling="2026-06-02 19:24:20.593210014 +0000 UTC m=+186.982254679" observedRunningTime="2026-06-02 19:24:20.948757954 +0000 UTC m=+187.337802640" watchObservedRunningTime="2026-06-02 19:24:20.950276338 +0000 UTC m=+187.339321025" Jun 02 19:24:21.004780 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004745 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-installation-pull-secrets\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.004780 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004785 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-image-registry-private-configuration\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.004974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004803 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-bound-sa-token\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.004974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004819 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-ca-trust-extracted\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.004974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004835 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-registry-tls\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.004974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004849 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hxqz\" (UniqueName: \"kubernetes.io/projected/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-kube-api-access-4hxqz\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.004974 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.004863 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bb27773-6cb1-4c6c-aba3-e8935f0320f4-trusted-ca\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:24:21.215072 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.215038 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-849c8b8c-858hk"] Jun 02 19:24:21.219113 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:21.219086 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-849c8b8c-858hk"] Jun 02 19:24:22.245873 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:22.245842 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" path="/var/lib/kubelet/pods/1bb27773-6cb1-4c6c-aba3-e8935f0320f4/volumes" Jun 02 19:24:24.911583 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:24.911548 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} Jun 02 19:24:24.911583 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:24.911585 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} Jun 02 19:24:26.921686 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:26.921641 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} Jun 02 19:24:26.922136 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:26.921701 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} Jun 02 19:24:26.922136 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:26.921716 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} Jun 02 19:24:26.922136 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:26.921730 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerStarted","Data":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} Jun 02 19:24:26.947500 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:26.947383 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.757136836 podStartE2EDuration="8.947367831s" podCreationTimestamp="2026-06-02 19:24:18 +0000 UTC" firstStartedPulling="2026-06-02 19:24:19.246810724 +0000 UTC m=+185.635855393" lastFinishedPulling="2026-06-02 19:24:26.437041724 +0000 UTC m=+192.826086388" observedRunningTime="2026-06-02 19:24:26.94622188 +0000 UTC m=+193.335266568" watchObservedRunningTime="2026-06-02 19:24:26.947367831 +0000 UTC m=+193.336412568" Jun 02 19:24:29.088045 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:29.088003 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:24:59.010096 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:59.010058 2572 generic.go:358] "Generic (PLEG): container finished" podID="0afe9edd-04cf-491a-a38b-6174cf70fcba" containerID="591b8b23060602bff8375edd1e00a1ed3fd18dd595d2f67b690e21d2616b6598" exitCode=0 Jun 02 19:24:59.010544 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:59.010131 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" event={"ID":"0afe9edd-04cf-491a-a38b-6174cf70fcba","Type":"ContainerDied","Data":"591b8b23060602bff8375edd1e00a1ed3fd18dd595d2f67b690e21d2616b6598"} Jun 02 19:24:59.010596 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:59.010539 2572 scope.go:117] "RemoveContainer" containerID="591b8b23060602bff8375edd1e00a1ed3fd18dd595d2f67b690e21d2616b6598" Jun 02 19:24:59.011333 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:59.011311 2572 generic.go:358] "Generic (PLEG): container finished" podID="27b15327-69d9-431d-b331-9d6f1dae6888" containerID="aa2e5ec77b8ebe3308d0d264a2f61ed5fe9317b29fb5b5dbb8d9c299cb840240" exitCode=0 Jun 02 19:24:59.011437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:59.011375 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-7kt78" event={"ID":"27b15327-69d9-431d-b331-9d6f1dae6888","Type":"ContainerDied","Data":"aa2e5ec77b8ebe3308d0d264a2f61ed5fe9317b29fb5b5dbb8d9c299cb840240"} Jun 02 19:24:59.011730 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:24:59.011711 2572 scope.go:117] "RemoveContainer" containerID="aa2e5ec77b8ebe3308d0d264a2f61ed5fe9317b29fb5b5dbb8d9c299cb840240" Jun 02 19:25:00.015296 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:00.015258 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ql8wb" event={"ID":"0afe9edd-04cf-491a-a38b-6174cf70fcba","Type":"ContainerStarted","Data":"adb1fc6f4184ce67e0ce32e4ddef30bef703d52abaf3b91e16150b0b768fbb32"} Jun 02 19:25:00.016798 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:00.016776 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-7kt78" event={"ID":"27b15327-69d9-431d-b331-9d6f1dae6888","Type":"ContainerStarted","Data":"96e49d1236abd8ee9f15195fea43123657276d98cce393c61c47d0bb5f93ca78"} Jun 02 19:25:19.088597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:19.088563 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:19.108293 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:19.108267 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:20.093826 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:20.093799 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:26.061718 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:26.061665 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:25:26.063972 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:26.063946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e23bb9ac-98b9-4039-9dec-4c57e10592bc-metrics-certs\") pod \"network-metrics-daemon-wls57\" (UID: \"e23bb9ac-98b9-4039-9dec-4c57e10592bc\") " pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:25:26.245792 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:26.245766 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tb5vh\"" Jun 02 19:25:26.253250 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:26.253230 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wls57" Jun 02 19:25:26.378880 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:26.378850 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wls57"] Jun 02 19:25:26.382922 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:25:26.382892 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23bb9ac_98b9_4039_9dec_4c57e10592bc.slice/crio-01beb6a5fe756bef2c3298747e43bb087c3f8c92a1a94f61c0de0c22891bfcc6 WatchSource:0}: Error finding container 01beb6a5fe756bef2c3298747e43bb087c3f8c92a1a94f61c0de0c22891bfcc6: Status 404 returned error can't find the container with id 01beb6a5fe756bef2c3298747e43bb087c3f8c92a1a94f61c0de0c22891bfcc6 Jun 02 19:25:27.101276 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:27.101230 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wls57" event={"ID":"e23bb9ac-98b9-4039-9dec-4c57e10592bc","Type":"ContainerStarted","Data":"01beb6a5fe756bef2c3298747e43bb087c3f8c92a1a94f61c0de0c22891bfcc6"} Jun 02 19:25:28.105684 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:28.105648 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wls57" event={"ID":"e23bb9ac-98b9-4039-9dec-4c57e10592bc","Type":"ContainerStarted","Data":"1bd55efea340d24e224448cfea3debae9b3382b3e4b479f1adccda336543f25d"} Jun 02 19:25:28.105684 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:28.105685 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wls57" event={"ID":"e23bb9ac-98b9-4039-9dec-4c57e10592bc","Type":"ContainerStarted","Data":"f6c1f750289a4e2b1481bf4011f6e1f39b1b9ff6d4ca7a95acf62cf6321be5ce"} Jun 02 19:25:28.126571 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:28.126530 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wls57" podStartSLOduration=253.190595278 podStartE2EDuration="4m14.126515602s" podCreationTimestamp="2026-06-02 19:21:14 +0000 UTC" firstStartedPulling="2026-06-02 19:25:26.384782383 +0000 UTC m=+252.773827053" lastFinishedPulling="2026-06-02 19:25:27.320702708 +0000 UTC m=+253.709747377" observedRunningTime="2026-06-02 19:25:28.125042422 +0000 UTC m=+254.514087121" watchObservedRunningTime="2026-06-02 19:25:28.126515602 +0000 UTC m=+254.515560290" Jun 02 19:25:37.222808 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.222716 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:25:37.223617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.223408 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="prometheus" containerID="cri-o://93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" gracePeriod=600 Jun 02 19:25:37.223617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.223438 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy" containerID="cri-o://2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" gracePeriod=600 Jun 02 19:25:37.223617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.223471 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="config-reloader" containerID="cri-o://bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" gracePeriod=600 Jun 02 19:25:37.223617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.223492 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="thanos-sidecar" containerID="cri-o://9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" gracePeriod=600 Jun 02 19:25:37.223617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.223541 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" gracePeriod=600 Jun 02 19:25:37.223617 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.223492 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-web" containerID="cri-o://f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" gracePeriod=600 Jun 02 19:25:37.463410 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.463384 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:37.545969 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.545931 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config-out\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.545980 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-db\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546008 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546035 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-metrics-client-certs\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546064 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-web-config\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546095 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-metrics-client-ca\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546125 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-grpc-tls\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546152 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpc2k\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-kube-api-access-wpc2k\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546184 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-kubelet-serving-ca-bundle\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546213 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-trusted-ca-bundle\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546236 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-tls\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546273 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546319 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-kube-rbac-proxy\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546341 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-rulefiles-0\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546375 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546407 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-tls-assets\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546449 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-serving-certs-ca-bundle\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.546490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546483 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-thanos-prometheus-http-client-file\") pod \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\" (UID: \"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4\") " Jun 02 19:25:37.547021 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546502 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:25:37.547021 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546731 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-metrics-client-ca\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.547021 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.546937 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:25:37.547183 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.547031 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:25:37.549392 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.547771 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:25:37.549392 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.549329 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:25:37.549819 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.549739 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.550036 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.550008 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:25:37.550408 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.550371 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.550680 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.550651 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.550992 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.550874 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.550992 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.550962 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config-out" (OuterVolumeSpecName: "config-out") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:25:37.551337 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.551311 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.551893 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.551860 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.555010 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.554980 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-kube-api-access-wpc2k" (OuterVolumeSpecName: "kube-api-access-wpc2k") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "kube-api-access-wpc2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:25:37.555102 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.555062 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config" (OuterVolumeSpecName: "config") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.555164 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.555127 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:25:37.555164 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.555127 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.566056 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.566022 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-web-config" (OuterVolumeSpecName: "web-config") pod "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" (UID: "fbdf93d4-98aa-459d-b21d-2a8ce3d593b4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:25:37.647068 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647029 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647068 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647063 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647068 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647073 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647083 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-kube-rbac-proxy\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647092 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647101 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647109 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-tls-assets\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647118 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647126 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647135 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-config-out\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647144 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-prometheus-k8s-db\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647153 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647162 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-metrics-client-certs\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647170 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-web-config\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647178 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-secret-grpc-tls\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647186 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpc2k\" (UniqueName: \"kubernetes.io/projected/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-kube-api-access-wpc2k\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:37.647291 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:37.647194 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:25:38.139220 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139184 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" exitCode=0 Jun 02 19:25:38.139220 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139214 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" exitCode=0 Jun 02 19:25:38.139220 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139224 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" exitCode=0 Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139232 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" exitCode=0 Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139240 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" exitCode=0 Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139247 2572 generic.go:358] "Generic (PLEG): container finished" podID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" exitCode=0 Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139258 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139298 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139314 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139324 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139327 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139333 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139345 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139353 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbdf93d4-98aa-459d-b21d-2a8ce3d593b4","Type":"ContainerDied","Data":"4944532784f486014744eafe1c6efea012c4a2f654de1ef44cf073d377df7c77"} Jun 02 19:25:38.139456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.139312 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.147188 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.147161 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.153345 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.153324 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.159332 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.159314 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.166116 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.166096 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.166528 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.166500 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:25:38.171910 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.171890 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:25:38.173112 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.173097 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.179683 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.179659 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.186735 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.186720 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.187013 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.186987 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.187067 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187013 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} err="failed to get container status \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" Jun 02 19:25:38.187067 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187033 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.187269 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.187254 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.187317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187271 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} err="failed to get container status \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" Jun 02 19:25:38.187317 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187283 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.187499 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.187481 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.187541 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187504 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} err="failed to get container status \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" Jun 02 19:25:38.187541 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187516 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.187754 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.187734 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.187799 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187758 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} err="failed to get container status \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" Jun 02 19:25:38.187799 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187774 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.187984 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.187962 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.188026 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.187988 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} err="failed to get container status \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" Jun 02 19:25:38.188026 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188003 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.188216 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.188201 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.188267 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188218 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} err="failed to get container status \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" Jun 02 19:25:38.188267 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188231 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.188495 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:25:38.188467 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.188599 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188499 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} err="failed to get container status \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" Jun 02 19:25:38.188599 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188517 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.188766 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188747 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} err="failed to get container status \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" Jun 02 19:25:38.188837 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.188768 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.189074 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189055 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} err="failed to get container status \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" Jun 02 19:25:38.189143 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189074 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.189330 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189311 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} err="failed to get container status \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" Jun 02 19:25:38.189393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189331 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.189575 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189557 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} err="failed to get container status \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" Jun 02 19:25:38.189628 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189575 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.189782 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189764 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} err="failed to get container status \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" Jun 02 19:25:38.189823 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189784 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.189963 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189947 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} err="failed to get container status \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" Jun 02 19:25:38.189963 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.189962 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.190180 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190161 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} err="failed to get container status \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" Jun 02 19:25:38.190224 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190181 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.190369 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190354 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} err="failed to get container status \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" Jun 02 19:25:38.190411 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190369 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.190587 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190567 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} err="failed to get container status \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" Jun 02 19:25:38.190637 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190587 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.190800 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190783 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} err="failed to get container status \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" Jun 02 19:25:38.190851 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190801 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.190987 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190971 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} err="failed to get container status \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" Jun 02 19:25:38.191030 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.190987 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.191175 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191158 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} err="failed to get container status \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" Jun 02 19:25:38.191219 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191176 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.191356 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191341 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} err="failed to get container status \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" Jun 02 19:25:38.191397 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191356 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.191608 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191589 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} err="failed to get container status \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" Jun 02 19:25:38.191657 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191608 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.191796 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191780 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} err="failed to get container status \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" Jun 02 19:25:38.191836 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191797 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.191990 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191963 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} err="failed to get container status \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" Jun 02 19:25:38.192045 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.191991 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.192165 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192148 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} err="failed to get container status \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" Jun 02 19:25:38.192204 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192167 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.192323 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192309 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} err="failed to get container status \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" Jun 02 19:25:38.192363 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192325 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.192544 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192528 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} err="failed to get container status \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" Jun 02 19:25:38.192544 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192543 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.192726 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192708 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} err="failed to get container status \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" Jun 02 19:25:38.192726 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192725 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.192907 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192891 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} err="failed to get container status \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" Jun 02 19:25:38.192907 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.192905 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.193079 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193061 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} err="failed to get container status \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" Jun 02 19:25:38.193079 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193078 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.193246 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193230 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} err="failed to get container status \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" Jun 02 19:25:38.193246 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193245 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.193397 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193383 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} err="failed to get container status \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" Jun 02 19:25:38.193458 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193398 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.193576 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193560 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} err="failed to get container status \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" Jun 02 19:25:38.193619 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193578 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.193742 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193728 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} err="failed to get container status \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" Jun 02 19:25:38.193783 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193741 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.193899 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193886 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} err="failed to get container status \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" Jun 02 19:25:38.193938 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.193898 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.194064 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194049 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} err="failed to get container status \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" Jun 02 19:25:38.194103 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194066 2572 scope.go:117] "RemoveContainer" containerID="9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8" Jun 02 19:25:38.194232 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194216 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8"} err="failed to get container status \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": rpc error: code = NotFound desc = could not find container \"9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8\": container with ID starting with 9a34c3bbc7c85d794249c138892bd4de426ee1b77392ff9b9d582990524a16a8 not found: ID does not exist" Jun 02 19:25:38.194267 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194233 2572 scope.go:117] "RemoveContainer" containerID="2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca" Jun 02 19:25:38.194467 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194443 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca"} err="failed to get container status \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": rpc error: code = NotFound desc = could not find container \"2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca\": container with ID starting with 2c14cebc150f49e95ae36baf029fccaa667a8e0ab1508c7e05f8e5020ad54aca not found: ID does not exist" Jun 02 19:25:38.194541 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194470 2572 scope.go:117] "RemoveContainer" containerID="f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a" Jun 02 19:25:38.194677 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194661 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a"} err="failed to get container status \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": rpc error: code = NotFound desc = could not find container \"f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a\": container with ID starting with f37385919de10720842521bb99902cb424e7e1c90d205ba694b1770b7358bc1a not found: ID does not exist" Jun 02 19:25:38.194718 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194677 2572 scope.go:117] "RemoveContainer" containerID="9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4" Jun 02 19:25:38.194845 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194831 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4"} err="failed to get container status \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": rpc error: code = NotFound desc = could not find container \"9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4\": container with ID starting with 9a4fed318258bc7caf49873b82ac82cdf666f7d521ee03bbe5a68263d85b56f4 not found: ID does not exist" Jun 02 19:25:38.194888 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.194857 2572 scope.go:117] "RemoveContainer" containerID="bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689" Jun 02 19:25:38.195055 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.195040 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689"} err="failed to get container status \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": rpc error: code = NotFound desc = could not find container \"bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689\": container with ID starting with bc57828a18b23c983f096c8ea79df3d690496365e47122c30a2acef1c5511689 not found: ID does not exist" Jun 02 19:25:38.195106 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.195055 2572 scope.go:117] "RemoveContainer" containerID="93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44" Jun 02 19:25:38.195199 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.195184 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44"} err="failed to get container status \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": rpc error: code = NotFound desc = could not find container \"93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44\": container with ID starting with 93dfd789fe5dc630a11413d49e4d68b0794f934d971467d1ed413dc69bd8fc44 not found: ID does not exist" Jun 02 19:25:38.195248 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.195199 2572 scope.go:117] "RemoveContainer" containerID="3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76" Jun 02 19:25:38.195393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.195377 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76"} err="failed to get container status \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": rpc error: code = NotFound desc = could not find container \"3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76\": container with ID starting with 3571c282de226e3e6a04f85f35cddc0a961ef4a8afdef84047dc214653349c76 not found: ID does not exist" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.201841 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202401 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-thanos" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202436 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-thanos" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202449 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" containerName="registry" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202458 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" containerName="registry" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202474 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="config-reloader" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202485 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="config-reloader" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202509 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="prometheus" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202517 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="prometheus" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202528 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-web" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202537 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-web" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202546 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="thanos-sidecar" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202554 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="thanos-sidecar" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202573 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202581 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202594 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="init-config-reloader" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202608 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="init-config-reloader" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202727 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bb27773-6cb1-4c6c-aba3-e8935f0320f4" containerName="registry" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202740 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-web" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202750 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy-thanos" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202768 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="kube-rbac-proxy" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202778 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="prometheus" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202787 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="config-reloader" Jun 02 19:25:38.204360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.202795 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" containerName="thanos-sidecar" Jun 02 19:25:38.208720 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.208694 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.211394 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211376 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 19:25:38.211491 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211380 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 19:25:38.211491 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211456 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 19:25:38.211577 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211535 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 19:25:38.211772 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211755 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 19:25:38.211835 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211760 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 19:25:38.211881 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211845 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 19:25:38.211918 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.211892 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 19:25:38.212117 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.212103 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 19:25:38.212117 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.212112 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1sg17diep8s1t\"" Jun 02 19:25:38.212226 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.212179 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 19:25:38.212276 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.212235 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9p2lr\"" Jun 02 19:25:38.212276 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.212243 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 19:25:38.217827 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.217522 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:25:38.218221 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.218200 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 19:25:38.219357 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.219339 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 19:25:38.245585 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.245555 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbdf93d4-98aa-459d-b21d-2a8ce3d593b4" path="/var/lib/kubelet/pods/fbdf93d4-98aa-459d-b21d-2a8ce3d593b4/volumes" Jun 02 19:25:38.252274 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252400 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252400 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252400 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252363 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3cebb08-1adb-4acb-b796-bf06df7991fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252597 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-config\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3cebb08-1adb-4acb-b796-bf06df7991fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.252872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.252838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpc4w\" (UniqueName: \"kubernetes.io/projected/e3cebb08-1adb-4acb-b796-bf06df7991fb-kube-api-access-lpc4w\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.353881 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.353829 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.353881 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.353884 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpc4w\" (UniqueName: \"kubernetes.io/projected/e3cebb08-1adb-4acb-b796-bf06df7991fb-kube-api-access-lpc4w\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.353909 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.353968 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354034 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354060 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354205 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3cebb08-1adb-4acb-b796-bf06df7991fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354245 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354293 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354329 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354364 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354391 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354444 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354475 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354506 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.354546 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354510 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.355029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354569 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-config\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.355029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354599 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.355029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.354641 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3cebb08-1adb-4acb-b796-bf06df7991fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.355181 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.355123 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.355181 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.355165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.356949 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.356919 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3cebb08-1adb-4acb-b796-bf06df7991fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.357131 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.357110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.357193 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.357133 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.357834 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.357560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.358437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.357902 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.358437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.357940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.358437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.357940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.358437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.358225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3cebb08-1adb-4acb-b796-bf06df7991fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.358437 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.358333 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3cebb08-1adb-4acb-b796-bf06df7991fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.358804 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.358781 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-config\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.359852 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.359832 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.360067 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.360047 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.360432 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.360398 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.360545 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.360529 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3cebb08-1adb-4acb-b796-bf06df7991fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.362323 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.362296 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpc4w\" (UniqueName: \"kubernetes.io/projected/e3cebb08-1adb-4acb-b796-bf06df7991fb-kube-api-access-lpc4w\") pod \"prometheus-k8s-0\" (UID: \"e3cebb08-1adb-4acb-b796-bf06df7991fb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.520594 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.520562 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:25:38.666148 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:38.666107 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:25:38.669087 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:25:38.669060 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3cebb08_1adb_4acb_b796_bf06df7991fb.slice/crio-cc31b87a510fa486306a253ec1710a50b032048000fc808612829489fb5f933d WatchSource:0}: Error finding container cc31b87a510fa486306a253ec1710a50b032048000fc808612829489fb5f933d: Status 404 returned error can't find the container with id cc31b87a510fa486306a253ec1710a50b032048000fc808612829489fb5f933d Jun 02 19:25:39.144499 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:39.144464 2572 generic.go:358] "Generic (PLEG): container finished" podID="e3cebb08-1adb-4acb-b796-bf06df7991fb" containerID="7d7842ad568502addd81e80f6099b3a57a6bfc7820a8c60df4207d326173964b" exitCode=0 Jun 02 19:25:39.144857 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:39.144525 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerDied","Data":"7d7842ad568502addd81e80f6099b3a57a6bfc7820a8c60df4207d326173964b"} Jun 02 19:25:39.144857 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:39.144546 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"cc31b87a510fa486306a253ec1710a50b032048000fc808612829489fb5f933d"} Jun 02 19:25:40.150490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.150451 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"e715aecc2c01c7459f91baea05f463adec5c82f3688e19d4a269a38d1c69c25c"} Jun 02 19:25:40.150490 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.150490 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"87db0b15f0bb1f8fad7332a38f18a0176c12d68026d6e602f860f21df67f11c8"} Jun 02 19:25:40.150945 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.150502 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"a0e1399501538673c435ee0e622c7a421af594091b3ea970ca0cf2c3d226120e"} Jun 02 19:25:40.150945 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.150512 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"f4c4b4c655c95f66cbc6234d9eb22d5e2b397222440c2ebe5dc9c5f352b54fbe"} Jun 02 19:25:40.150945 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.150523 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"f462b50f588e5d1b0bdc6921ddb6373c313bb7139220ee63ba611aea0071449b"} Jun 02 19:25:40.150945 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.150535 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3cebb08-1adb-4acb-b796-bf06df7991fb","Type":"ContainerStarted","Data":"90a17ae862f7b9a8830c00d58a8abcaf281296b97a7c000b60d2c310344f0c41"} Jun 02 19:25:40.179668 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:40.179611 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.179593649 podStartE2EDuration="2.179593649s" podCreationTimestamp="2026-06-02 19:25:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:25:40.177711202 +0000 UTC m=+266.566755889" watchObservedRunningTime="2026-06-02 19:25:40.179593649 +0000 UTC m=+266.568638338" Jun 02 19:25:43.521313 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:25:43.521278 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:26:14.139727 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:14.139697 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:26:14.140667 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:14.140647 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:26:14.143411 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:14.143390 2572 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 19:26:17.060655 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.060618 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zlvlh"] Jun 02 19:26:17.063660 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.063645 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.066163 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.066145 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 19:26:17.072520 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.072486 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zlvlh"] Jun 02 19:26:17.180048 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.180008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62b47b5d-5386-4329-86ea-b6ba0db81794-dbus\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.180225 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.180090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62b47b5d-5386-4329-86ea-b6ba0db81794-kubelet-config\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.180225 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.180130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62b47b5d-5386-4329-86ea-b6ba0db81794-original-pull-secret\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.280580 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.280536 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62b47b5d-5386-4329-86ea-b6ba0db81794-dbus\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.280774 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.280621 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62b47b5d-5386-4329-86ea-b6ba0db81794-kubelet-config\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.280774 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.280659 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62b47b5d-5386-4329-86ea-b6ba0db81794-original-pull-secret\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.280774 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.280723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62b47b5d-5386-4329-86ea-b6ba0db81794-dbus\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.280774 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.280753 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62b47b5d-5386-4329-86ea-b6ba0db81794-kubelet-config\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.283006 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.282983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62b47b5d-5386-4329-86ea-b6ba0db81794-original-pull-secret\") pod \"global-pull-secret-syncer-zlvlh\" (UID: \"62b47b5d-5386-4329-86ea-b6ba0db81794\") " pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.374545 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.374454 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlvlh" Jun 02 19:26:17.498965 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.498931 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zlvlh"] Jun 02 19:26:17.502152 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:26:17.502124 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b47b5d_5386_4329_86ea_b6ba0db81794.slice/crio-aea0bc8ce5727f97a455a0bac9363ca919f77bfaccf47fdff68e0506dcd5c66f WatchSource:0}: Error finding container aea0bc8ce5727f97a455a0bac9363ca919f77bfaccf47fdff68e0506dcd5c66f: Status 404 returned error can't find the container with id aea0bc8ce5727f97a455a0bac9363ca919f77bfaccf47fdff68e0506dcd5c66f Jun 02 19:26:17.503730 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:17.503716 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:26:18.263298 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:18.263256 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zlvlh" event={"ID":"62b47b5d-5386-4329-86ea-b6ba0db81794","Type":"ContainerStarted","Data":"aea0bc8ce5727f97a455a0bac9363ca919f77bfaccf47fdff68e0506dcd5c66f"} Jun 02 19:26:21.272532 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:21.272465 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zlvlh" event={"ID":"62b47b5d-5386-4329-86ea-b6ba0db81794","Type":"ContainerStarted","Data":"94a6bf27ad1e6ce46ff3945ae99d66cbb328e073f3f3c98170951b13ca7e34d7"} Jun 02 19:26:21.287197 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:21.287142 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zlvlh" podStartSLOduration=0.733279322 podStartE2EDuration="4.287120455s" podCreationTimestamp="2026-06-02 19:26:17 +0000 UTC" firstStartedPulling="2026-06-02 19:26:17.503851718 +0000 UTC m=+303.892896383" lastFinishedPulling="2026-06-02 19:26:21.057692849 +0000 UTC m=+307.446737516" observedRunningTime="2026-06-02 19:26:21.286712709 +0000 UTC m=+307.675757397" watchObservedRunningTime="2026-06-02 19:26:21.287120455 +0000 UTC m=+307.676165143" Jun 02 19:26:38.520866 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:38.520826 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:26:38.535857 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:38.535832 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:26:39.336824 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:26:39.336798 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:27:31.694147 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.694110 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-kxqxh"] Jun 02 19:27:31.696194 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.696177 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:31.698920 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.698895 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 19:27:31.699958 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.699933 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zm8v8\"" Jun 02 19:27:31.700046 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.699957 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 19:27:31.705385 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.705360 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-kxqxh"] Jun 02 19:27:31.889191 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.889149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cc1b95b-2204-4c3a-90ae-c23baa6a1128-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-kxqxh\" (UID: \"6cc1b95b-2204-4c3a-90ae-c23baa6a1128\") " pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:31.889364 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.889219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwh7k\" (UniqueName: \"kubernetes.io/projected/6cc1b95b-2204-4c3a-90ae-c23baa6a1128-kube-api-access-qwh7k\") pod \"cert-manager-webhook-587ccfb98-kxqxh\" (UID: \"6cc1b95b-2204-4c3a-90ae-c23baa6a1128\") " pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:31.990268 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.990233 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwh7k\" (UniqueName: \"kubernetes.io/projected/6cc1b95b-2204-4c3a-90ae-c23baa6a1128-kube-api-access-qwh7k\") pod \"cert-manager-webhook-587ccfb98-kxqxh\" (UID: \"6cc1b95b-2204-4c3a-90ae-c23baa6a1128\") " pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:31.990476 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.990326 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cc1b95b-2204-4c3a-90ae-c23baa6a1128-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-kxqxh\" (UID: \"6cc1b95b-2204-4c3a-90ae-c23baa6a1128\") " pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:31.999011 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.998988 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cc1b95b-2204-4c3a-90ae-c23baa6a1128-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-kxqxh\" (UID: \"6cc1b95b-2204-4c3a-90ae-c23baa6a1128\") " pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:31.999152 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:31.999134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwh7k\" (UniqueName: \"kubernetes.io/projected/6cc1b95b-2204-4c3a-90ae-c23baa6a1128-kube-api-access-qwh7k\") pod \"cert-manager-webhook-587ccfb98-kxqxh\" (UID: \"6cc1b95b-2204-4c3a-90ae-c23baa6a1128\") " pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:32.014011 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:32.013956 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:32.138335 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:32.138304 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-kxqxh"] Jun 02 19:27:32.141569 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:27:32.141539 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cc1b95b_2204_4c3a_90ae_c23baa6a1128.slice/crio-bf527739a990f3742720c35b479f19a0c5c4410a4f807870a931582e50921dd6 WatchSource:0}: Error finding container bf527739a990f3742720c35b479f19a0c5c4410a4f807870a931582e50921dd6: Status 404 returned error can't find the container with id bf527739a990f3742720c35b479f19a0c5c4410a4f807870a931582e50921dd6 Jun 02 19:27:32.469610 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:32.469504 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" event={"ID":"6cc1b95b-2204-4c3a-90ae-c23baa6a1128","Type":"ContainerStarted","Data":"bf527739a990f3742720c35b479f19a0c5c4410a4f807870a931582e50921dd6"} Jun 02 19:27:36.482666 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:36.482631 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" event={"ID":"6cc1b95b-2204-4c3a-90ae-c23baa6a1128","Type":"ContainerStarted","Data":"979d45298d27395cdaaa5f8496599ae9a49d1c1245eb4f8fd132f0e7cd9078ab"} Jun 02 19:27:36.483071 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:36.482690 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:36.500230 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:36.500179 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" podStartSLOduration=1.68156033 podStartE2EDuration="5.500166665s" podCreationTimestamp="2026-06-02 19:27:31 +0000 UTC" firstStartedPulling="2026-06-02 19:27:32.143553358 +0000 UTC m=+378.532598023" lastFinishedPulling="2026-06-02 19:27:35.96215969 +0000 UTC m=+382.351204358" observedRunningTime="2026-06-02 19:27:36.49912049 +0000 UTC m=+382.888165202" watchObservedRunningTime="2026-06-02 19:27:36.500166665 +0000 UTC m=+382.889211351" Jun 02 19:27:42.487688 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:42.487659 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-kxqxh" Jun 02 19:27:45.232081 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.232050 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bf9ms"] Jun 02 19:27:45.234276 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.234250 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.236960 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.236940 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mpqsk\"" Jun 02 19:27:45.244548 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.244524 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bf9ms"] Jun 02 19:27:45.284855 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.284820 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f00bc3-88b3-4f04-a9c0-6a92483fc351-bound-sa-token\") pod \"cert-manager-79c8d999ff-bf9ms\" (UID: \"d4f00bc3-88b3-4f04-a9c0-6a92483fc351\") " pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.284855 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.284858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg78t\" (UniqueName: \"kubernetes.io/projected/d4f00bc3-88b3-4f04-a9c0-6a92483fc351-kube-api-access-hg78t\") pod \"cert-manager-79c8d999ff-bf9ms\" (UID: \"d4f00bc3-88b3-4f04-a9c0-6a92483fc351\") " pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.385463 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.385411 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f00bc3-88b3-4f04-a9c0-6a92483fc351-bound-sa-token\") pod \"cert-manager-79c8d999ff-bf9ms\" (UID: \"d4f00bc3-88b3-4f04-a9c0-6a92483fc351\") " pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.385631 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.385485 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg78t\" (UniqueName: \"kubernetes.io/projected/d4f00bc3-88b3-4f04-a9c0-6a92483fc351-kube-api-access-hg78t\") pod \"cert-manager-79c8d999ff-bf9ms\" (UID: \"d4f00bc3-88b3-4f04-a9c0-6a92483fc351\") " pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.394035 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.393998 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f00bc3-88b3-4f04-a9c0-6a92483fc351-bound-sa-token\") pod \"cert-manager-79c8d999ff-bf9ms\" (UID: \"d4f00bc3-88b3-4f04-a9c0-6a92483fc351\") " pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.394136 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.394007 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg78t\" (UniqueName: \"kubernetes.io/projected/d4f00bc3-88b3-4f04-a9c0-6a92483fc351-kube-api-access-hg78t\") pod \"cert-manager-79c8d999ff-bf9ms\" (UID: \"d4f00bc3-88b3-4f04-a9c0-6a92483fc351\") " pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.543767 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.543731 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bf9ms" Jun 02 19:27:45.673707 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:45.673682 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bf9ms"] Jun 02 19:27:45.676128 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:27:45.676099 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4f00bc3_88b3_4f04_a9c0_6a92483fc351.slice/crio-b3189018a906e99f9c9c15ed187522fe3eae2d2195a82358c148a5883eb8db61 WatchSource:0}: Error finding container b3189018a906e99f9c9c15ed187522fe3eae2d2195a82358c148a5883eb8db61: Status 404 returned error can't find the container with id b3189018a906e99f9c9c15ed187522fe3eae2d2195a82358c148a5883eb8db61 Jun 02 19:27:46.514246 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:46.514206 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bf9ms" event={"ID":"d4f00bc3-88b3-4f04-a9c0-6a92483fc351","Type":"ContainerStarted","Data":"5236ae49aa18c950bae03141060997757557e5198591927f15beb01dc456d658"} Jun 02 19:27:46.514655 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:46.514253 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bf9ms" event={"ID":"d4f00bc3-88b3-4f04-a9c0-6a92483fc351","Type":"ContainerStarted","Data":"b3189018a906e99f9c9c15ed187522fe3eae2d2195a82358c148a5883eb8db61"} Jun 02 19:27:46.531310 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:27:46.531263 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-bf9ms" podStartSLOduration=1.5312488229999999 podStartE2EDuration="1.531248823s" podCreationTimestamp="2026-06-02 19:27:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:27:46.529510962 +0000 UTC m=+392.918555647" watchObservedRunningTime="2026-06-02 19:27:46.531248823 +0000 UTC m=+392.920293510" Jun 02 19:28:34.419466 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.419375 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk"] Jun 02 19:28:34.421658 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.421636 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.424306 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.424276 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:28:34.425470 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.425415 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 19:28:34.425470 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.425456 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 19:28:34.425470 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.425483 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 19:28:34.425764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.425483 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5d6cm\"" Jun 02 19:28:34.425764 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.425534 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 19:28:34.430521 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.430500 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk"] Jun 02 19:28:34.590024 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.589994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6695574-7c69-45db-b256-cd4921a81de0-cert\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.590202 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.590033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c6695574-7c69-45db-b256-cd4921a81de0-manager-config\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.590202 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.590072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7svx\" (UniqueName: \"kubernetes.io/projected/c6695574-7c69-45db-b256-cd4921a81de0-kube-api-access-r7svx\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.590202 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.590100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6695574-7c69-45db-b256-cd4921a81de0-metrics-cert\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.691369 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.691272 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6695574-7c69-45db-b256-cd4921a81de0-cert\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.691369 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.691328 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c6695574-7c69-45db-b256-cd4921a81de0-manager-config\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.691621 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.691387 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7svx\" (UniqueName: \"kubernetes.io/projected/c6695574-7c69-45db-b256-cd4921a81de0-kube-api-access-r7svx\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.691621 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.691454 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6695574-7c69-45db-b256-cd4921a81de0-metrics-cert\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.691961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.691939 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c6695574-7c69-45db-b256-cd4921a81de0-manager-config\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.694033 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.694001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6695574-7c69-45db-b256-cd4921a81de0-metrics-cert\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.694033 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.694021 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6695574-7c69-45db-b256-cd4921a81de0-cert\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.700841 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.700814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7svx\" (UniqueName: \"kubernetes.io/projected/c6695574-7c69-45db-b256-cd4921a81de0-kube-api-access-r7svx\") pod \"lws-controller-manager-77ccbc7d9-kl4nk\" (UID: \"c6695574-7c69-45db-b256-cd4921a81de0\") " pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.731527 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.731501 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:34.857250 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:34.857196 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk"] Jun 02 19:28:34.859691 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:28:34.859659 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6695574_7c69_45db_b256_cd4921a81de0.slice/crio-ac05bc3fc087fc8fd091d9453ae3b8137756491e7f413b1f6a9019568d61988a WatchSource:0}: Error finding container ac05bc3fc087fc8fd091d9453ae3b8137756491e7f413b1f6a9019568d61988a: Status 404 returned error can't find the container with id ac05bc3fc087fc8fd091d9453ae3b8137756491e7f413b1f6a9019568d61988a Jun 02 19:28:35.649747 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:35.649700 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" event={"ID":"c6695574-7c69-45db-b256-cd4921a81de0","Type":"ContainerStarted","Data":"ac05bc3fc087fc8fd091d9453ae3b8137756491e7f413b1f6a9019568d61988a"} Jun 02 19:28:38.658994 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:38.658960 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" event={"ID":"c6695574-7c69-45db-b256-cd4921a81de0","Type":"ContainerStarted","Data":"d7db1a7c3c79034ea1b906cb4d73536187760fd58ec51090fc94e9391d246bf3"} Jun 02 19:28:38.659377 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:38.659019 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:38.676331 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:38.676280 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" podStartSLOduration=1.052440321 podStartE2EDuration="4.676266659s" podCreationTimestamp="2026-06-02 19:28:34 +0000 UTC" firstStartedPulling="2026-06-02 19:28:34.861776715 +0000 UTC m=+441.250821383" lastFinishedPulling="2026-06-02 19:28:38.485603057 +0000 UTC m=+444.874647721" observedRunningTime="2026-06-02 19:28:38.674942026 +0000 UTC m=+445.063986712" watchObservedRunningTime="2026-06-02 19:28:38.676266659 +0000 UTC m=+445.065311339" Jun 02 19:28:43.892830 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.892793 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f"] Jun 02 19:28:43.895661 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.895637 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:43.900410 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.900388 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 19:28:43.900754 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.900729 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 19:28:43.900857 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.900743 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 19:28:43.900857 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.900850 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pvrvq\"" Jun 02 19:28:43.901048 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.901034 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 19:28:43.914340 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:43.914307 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f"] Jun 02 19:28:44.071695 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.071657 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-manifests\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.071873 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.071760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.071873 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.071795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sxlt\" (UniqueName: \"kubernetes.io/projected/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-kube-api-access-5sxlt\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.071873 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.071824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-tmp\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.071873 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.071845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.173225 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.173135 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-manifests\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.173379 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.173259 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.173379 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.173282 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlt\" (UniqueName: \"kubernetes.io/projected/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-kube-api-access-5sxlt\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.173379 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.173310 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-tmp\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.173379 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.173327 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.173554 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.173400 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-manifests\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.176234 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.176202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-tmp\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.176346 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.176290 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.176346 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.176299 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.181281 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.181262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sxlt\" (UniqueName: \"kubernetes.io/projected/b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf-kube-api-access-5sxlt\") pod \"opendatahub-operator-controller-manager-b5889499b-wcf2f\" (UID: \"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf\") " pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.206190 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.206162 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:44.349122 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.349089 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f"] Jun 02 19:28:44.353196 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:28:44.353159 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23bd30f_071e_4ca4_a5a5_7bef48e8ebbf.slice/crio-9dcecc6df181de2c1bcbffe6e760d3a548d1c52d10bf3276768e821a83c1be0d WatchSource:0}: Error finding container 9dcecc6df181de2c1bcbffe6e760d3a548d1c52d10bf3276768e821a83c1be0d: Status 404 returned error can't find the container with id 9dcecc6df181de2c1bcbffe6e760d3a548d1c52d10bf3276768e821a83c1be0d Jun 02 19:28:44.677092 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:44.677048 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" event={"ID":"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf","Type":"ContainerStarted","Data":"9dcecc6df181de2c1bcbffe6e760d3a548d1c52d10bf3276768e821a83c1be0d"} Jun 02 19:28:47.687311 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:47.687273 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" event={"ID":"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf","Type":"ContainerStarted","Data":"91536c89935a6ea413b01ee50f07ac6518effbd050cc9a82e5b2c10a6b86dcfd"} Jun 02 19:28:48.691939 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:48.691817 2572 generic.go:358] "Generic (PLEG): container finished" podID="b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf" containerID="91536c89935a6ea413b01ee50f07ac6518effbd050cc9a82e5b2c10a6b86dcfd" exitCode=0 Jun 02 19:28:48.691939 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:48.691872 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" event={"ID":"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf","Type":"ContainerDied","Data":"91536c89935a6ea413b01ee50f07ac6518effbd050cc9a82e5b2c10a6b86dcfd"} Jun 02 19:28:49.664590 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:49.664557 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77ccbc7d9-kl4nk" Jun 02 19:28:49.700167 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:49.700130 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" event={"ID":"b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf","Type":"ContainerStarted","Data":"eb970b3fc6a71c6f4412de3bf875b13ec14e6033b9aaec906d3effb1f786ba43"} Jun 02 19:28:49.700781 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:49.700760 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:28:49.725997 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:28:49.725940 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" podStartSLOduration=2.035168473 podStartE2EDuration="6.725925763s" podCreationTimestamp="2026-06-02 19:28:43 +0000 UTC" firstStartedPulling="2026-06-02 19:28:44.354875639 +0000 UTC m=+450.743920303" lastFinishedPulling="2026-06-02 19:28:49.045632924 +0000 UTC m=+455.434677593" observedRunningTime="2026-06-02 19:28:49.725333935 +0000 UTC m=+456.114378666" watchObservedRunningTime="2026-06-02 19:28:49.725925763 +0000 UTC m=+456.114970450" Jun 02 19:29:00.705574 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:00.705543 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b5889499b-wcf2f" Jun 02 19:29:14.062691 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.062654 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4"] Jun 02 19:29:14.067382 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.067347 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.070224 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.070201 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 19:29:14.071016 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.070994 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 19:29:14.071159 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.071019 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 19:29:14.071159 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.071046 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 19:29:14.071159 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.071019 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jbl77\"" Jun 02 19:29:14.082086 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.082052 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4"] Jun 02 19:29:14.137822 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.137785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59107e56-2c3e-4272-9de6-4d15ade2abb7-tls-certs\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.137822 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.137823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xdz\" (UniqueName: \"kubernetes.io/projected/59107e56-2c3e-4272-9de6-4d15ade2abb7-kube-api-access-56xdz\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.138084 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.137901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59107e56-2c3e-4272-9de6-4d15ade2abb7-tmp\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.238537 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.238508 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59107e56-2c3e-4272-9de6-4d15ade2abb7-tls-certs\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.238537 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.238540 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56xdz\" (UniqueName: \"kubernetes.io/projected/59107e56-2c3e-4272-9de6-4d15ade2abb7-kube-api-access-56xdz\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.238738 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.238592 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59107e56-2c3e-4272-9de6-4d15ade2abb7-tmp\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.240824 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.240800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59107e56-2c3e-4272-9de6-4d15ade2abb7-tmp\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.241300 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.241282 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 19:29:14.247211 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.247186 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 19:29:14.251233 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.251207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59107e56-2c3e-4272-9de6-4d15ade2abb7-tls-certs\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.258716 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.258694 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 19:29:14.268445 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.268399 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xdz\" (UniqueName: \"kubernetes.io/projected/59107e56-2c3e-4272-9de6-4d15ade2abb7-kube-api-access-56xdz\") pod \"kube-auth-proxy-897b5b6bb-5bpt4\" (UID: \"59107e56-2c3e-4272-9de6-4d15ade2abb7\") " pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.380998 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.380917 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jbl77\"" Jun 02 19:29:14.389195 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.389176 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" Jun 02 19:29:14.529977 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.529943 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4"] Jun 02 19:29:14.533857 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:29:14.533827 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59107e56_2c3e_4272_9de6_4d15ade2abb7.slice/crio-4e41a235e8ce6ec038066ec769ca907acd13e27a65eebc1289fc4edc8dfece37 WatchSource:0}: Error finding container 4e41a235e8ce6ec038066ec769ca907acd13e27a65eebc1289fc4edc8dfece37: Status 404 returned error can't find the container with id 4e41a235e8ce6ec038066ec769ca907acd13e27a65eebc1289fc4edc8dfece37 Jun 02 19:29:14.784484 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:14.784449 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" event={"ID":"59107e56-2c3e-4272-9de6-4d15ade2abb7","Type":"ContainerStarted","Data":"4e41a235e8ce6ec038066ec769ca907acd13e27a65eebc1289fc4edc8dfece37"} Jun 02 19:29:17.651874 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:17.651849 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 19:29:17.795632 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:17.795600 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" event={"ID":"59107e56-2c3e-4272-9de6-4d15ade2abb7","Type":"ContainerStarted","Data":"5b056b79a09c2c77ae5d46445c772664e5b7778b1a9c7f15ceaba786ca90abb1"} Jun 02 19:29:17.813636 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:29:17.813591 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-897b5b6bb-5bpt4" podStartSLOduration=0.700001773 podStartE2EDuration="3.813577189s" podCreationTimestamp="2026-06-02 19:29:14 +0000 UTC" firstStartedPulling="2026-06-02 19:29:14.535710994 +0000 UTC m=+480.924755659" lastFinishedPulling="2026-06-02 19:29:17.64928641 +0000 UTC m=+484.038331075" observedRunningTime="2026-06-02 19:29:17.812802758 +0000 UTC m=+484.201847446" watchObservedRunningTime="2026-06-02 19:29:17.813577189 +0000 UTC m=+484.202621902" Jun 02 19:30:46.331457 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.331405 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5"] Jun 02 19:30:46.333852 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.333833 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:30:46.336635 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.336613 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:30:46.336750 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.336615 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bv8vp\"" Jun 02 19:30:46.337054 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.337038 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:30:46.342967 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.342941 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5"] Jun 02 19:30:46.451246 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.451211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwztd\" (UniqueName: \"kubernetes.io/projected/4200a383-30d2-4219-84cb-f29413f704f4-kube-api-access-bwztd\") pod \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" (UID: \"4200a383-30d2-4219-84cb-f29413f704f4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:30:46.551805 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.551761 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwztd\" (UniqueName: \"kubernetes.io/projected/4200a383-30d2-4219-84cb-f29413f704f4-kube-api-access-bwztd\") pod \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" (UID: \"4200a383-30d2-4219-84cb-f29413f704f4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:30:46.565682 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.565658 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwztd\" (UniqueName: \"kubernetes.io/projected/4200a383-30d2-4219-84cb-f29413f704f4-kube-api-access-bwztd\") pod \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" (UID: \"4200a383-30d2-4219-84cb-f29413f704f4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:30:46.645192 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.645107 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:30:46.774099 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:46.774072 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5"] Jun 02 19:30:46.776852 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:30:46.776822 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4200a383_30d2_4219_84cb_f29413f704f4.slice/crio-ead5c48c3198e53ada027e50ff7b9a71bd8727c78a3c835db87f13298bc57087 WatchSource:0}: Error finding container ead5c48c3198e53ada027e50ff7b9a71bd8727c78a3c835db87f13298bc57087: Status 404 returned error can't find the container with id ead5c48c3198e53ada027e50ff7b9a71bd8727c78a3c835db87f13298bc57087 Jun 02 19:30:47.090478 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:47.090434 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" event={"ID":"4200a383-30d2-4219-84cb-f29413f704f4","Type":"ContainerStarted","Data":"ead5c48c3198e53ada027e50ff7b9a71bd8727c78a3c835db87f13298bc57087"} Jun 02 19:30:49.098959 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:49.098924 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" event={"ID":"4200a383-30d2-4219-84cb-f29413f704f4","Type":"ContainerStarted","Data":"c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c"} Jun 02 19:30:49.099389 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:49.099019 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:30:49.117273 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:30:49.117219 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" podStartSLOduration=0.904565093 podStartE2EDuration="3.117203791s" podCreationTimestamp="2026-06-02 19:30:46 +0000 UTC" firstStartedPulling="2026-06-02 19:30:46.779235844 +0000 UTC m=+573.168280509" lastFinishedPulling="2026-06-02 19:30:48.991874537 +0000 UTC m=+575.380919207" observedRunningTime="2026-06-02 19:30:49.115105758 +0000 UTC m=+575.504150445" watchObservedRunningTime="2026-06-02 19:30:49.117203791 +0000 UTC m=+575.506248478" Jun 02 19:31:00.104642 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:00.104611 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:31:03.411467 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.411408 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5"] Jun 02 19:31:03.411847 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.411646 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" podUID="4200a383-30d2-4219-84cb-f29413f704f4" containerName="manager" containerID="cri-o://c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c" gracePeriod=2 Jun 02 19:31:03.432952 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.432922 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5"] Jun 02 19:31:03.646145 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.646117 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:31:03.649618 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.649588 2572 status_manager.go:895] "Failed to get status for pod" podUID="4200a383-30d2-4219-84cb-f29413f704f4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" is forbidden: User \"system:node:ip-10-0-128-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-46.ec2.internal' and this object" Jun 02 19:31:03.813183 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.813144 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwztd\" (UniqueName: \"kubernetes.io/projected/4200a383-30d2-4219-84cb-f29413f704f4-kube-api-access-bwztd\") pod \"4200a383-30d2-4219-84cb-f29413f704f4\" (UID: \"4200a383-30d2-4219-84cb-f29413f704f4\") " Jun 02 19:31:03.815275 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.815243 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4200a383-30d2-4219-84cb-f29413f704f4-kube-api-access-bwztd" (OuterVolumeSpecName: "kube-api-access-bwztd") pod "4200a383-30d2-4219-84cb-f29413f704f4" (UID: "4200a383-30d2-4219-84cb-f29413f704f4"). InnerVolumeSpecName "kube-api-access-bwztd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:31:03.914646 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:03.914609 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwztd\" (UniqueName: \"kubernetes.io/projected/4200a383-30d2-4219-84cb-f29413f704f4-kube-api-access-bwztd\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:31:04.148722 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.148635 2572 generic.go:358] "Generic (PLEG): container finished" podID="4200a383-30d2-4219-84cb-f29413f704f4" containerID="c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c" exitCode=0 Jun 02 19:31:04.148722 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.148681 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" Jun 02 19:31:04.148916 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.148687 2572 scope.go:117] "RemoveContainer" containerID="c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c" Jun 02 19:31:04.151112 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.151083 2572 status_manager.go:895] "Failed to get status for pod" podUID="4200a383-30d2-4219-84cb-f29413f704f4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" is forbidden: User \"system:node:ip-10-0-128-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-46.ec2.internal' and this object" Jun 02 19:31:04.156897 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.156874 2572 scope.go:117] "RemoveContainer" containerID="c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c" Jun 02 19:31:04.157142 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:31:04.157121 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c\": container with ID starting with c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c not found: ID does not exist" containerID="c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c" Jun 02 19:31:04.157203 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.157150 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c"} err="failed to get container status \"c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c\": rpc error: code = NotFound desc = could not find container \"c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c\": container with ID starting with c2e506a6050f6ae6210f58cbb3e18cb404afde7c071e3bf52547cc28996bb24c not found: ID does not exist" Jun 02 19:31:04.158826 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.158801 2572 status_manager.go:895] "Failed to get status for pod" podUID="4200a383-30d2-4219-84cb-f29413f704f4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" is forbidden: User \"system:node:ip-10-0-128-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-46.ec2.internal' and this object" Jun 02 19:31:04.245723 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.245667 2572 status_manager.go:895] "Failed to get status for pod" podUID="4200a383-30d2-4219-84cb-f29413f704f4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5xx5" err="pods \"limitador-operator-controller-manager-85c4996f8c-c5xx5\" is forbidden: User \"system:node:ip-10-0-128-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-46.ec2.internal' and this object" Jun 02 19:31:04.246848 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:04.246818 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4200a383-30d2-4219-84cb-f29413f704f4" path="/var/lib/kubelet/pods/4200a383-30d2-4219-84cb-f29413f704f4/volumes" Jun 02 19:31:14.164086 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:14.164059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:31:14.164562 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:14.164447 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:31:54.348712 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.348669 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:31:54.349144 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.348991 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4200a383-30d2-4219-84cb-f29413f704f4" containerName="manager" Jun 02 19:31:54.349144 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.349002 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4200a383-30d2-4219-84cb-f29413f704f4" containerName="manager" Jun 02 19:31:54.349144 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.349068 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="4200a383-30d2-4219-84cb-f29413f704f4" containerName="manager" Jun 02 19:31:54.350956 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.350938 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.353449 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.353411 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 19:31:54.353607 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.353409 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:31:54.354331 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.354309 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dv7bn\"" Jun 02 19:31:54.354331 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.354328 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:31:54.358767 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.358743 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:31:54.443305 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.443270 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:31:54.443610 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.443587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pcvz\" (UniqueName: \"kubernetes.io/projected/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-kube-api-access-8pcvz\") pod \"limitador-limitador-7d549b5b-mvqgv\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.443710 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.443690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-config-file\") pod \"limitador-limitador-7d549b5b-mvqgv\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.544233 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.544194 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcvz\" (UniqueName: \"kubernetes.io/projected/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-kube-api-access-8pcvz\") pod \"limitador-limitador-7d549b5b-mvqgv\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.544445 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.544259 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-config-file\") pod \"limitador-limitador-7d549b5b-mvqgv\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.544866 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.544847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-config-file\") pod \"limitador-limitador-7d549b5b-mvqgv\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.552622 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.552589 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcvz\" (UniqueName: \"kubernetes.io/projected/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-kube-api-access-8pcvz\") pod \"limitador-limitador-7d549b5b-mvqgv\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.661575 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.661480 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:31:54.789195 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.789154 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:31:54.792208 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:31:54.792180 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095d7bdc_46c1_4f3a_b64e_5b427f2386e0.slice/crio-02d8f6d829f623f7f6ee4d64a92068e833dd4973dca6c5e1ca3897a655268498 WatchSource:0}: Error finding container 02d8f6d829f623f7f6ee4d64a92068e833dd4973dca6c5e1ca3897a655268498: Status 404 returned error can't find the container with id 02d8f6d829f623f7f6ee4d64a92068e833dd4973dca6c5e1ca3897a655268498 Jun 02 19:31:54.793943 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:54.793928 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:31:55.186932 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.186897 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b6dnb"] Jun 02 19:31:55.189954 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.189933 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:31:55.195733 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.195705 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sw7vx\"" Jun 02 19:31:55.202802 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.202777 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b6dnb"] Jun 02 19:31:55.250496 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.250460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8qk7\" (UniqueName: \"kubernetes.io/projected/4eeb5065-daf1-44cc-83ad-96156622cdee-kube-api-access-n8qk7\") pod \"authorino-f99f4b5cd-b6dnb\" (UID: \"4eeb5065-daf1-44cc-83ad-96156622cdee\") " pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:31:55.314610 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.314565 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" event={"ID":"095d7bdc-46c1-4f3a-b64e-5b427f2386e0","Type":"ContainerStarted","Data":"02d8f6d829f623f7f6ee4d64a92068e833dd4973dca6c5e1ca3897a655268498"} Jun 02 19:31:55.351037 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.350999 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8qk7\" (UniqueName: \"kubernetes.io/projected/4eeb5065-daf1-44cc-83ad-96156622cdee-kube-api-access-n8qk7\") pod \"authorino-f99f4b5cd-b6dnb\" (UID: \"4eeb5065-daf1-44cc-83ad-96156622cdee\") " pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:31:55.360050 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.360018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8qk7\" (UniqueName: \"kubernetes.io/projected/4eeb5065-daf1-44cc-83ad-96156622cdee-kube-api-access-n8qk7\") pod \"authorino-f99f4b5cd-b6dnb\" (UID: \"4eeb5065-daf1-44cc-83ad-96156622cdee\") " pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:31:55.434747 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.434715 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-dw7g2"] Jun 02 19:31:55.436772 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.436754 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:31:55.444898 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.444871 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-dw7g2"] Jun 02 19:31:55.499582 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.499542 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:31:55.553736 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.553703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfpdd\" (UniqueName: \"kubernetes.io/projected/c4d3bc42-3e10-42e7-9bf1-a8df381558b7-kube-api-access-mfpdd\") pod \"authorino-7498df8756-dw7g2\" (UID: \"c4d3bc42-3e10-42e7-9bf1-a8df381558b7\") " pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:31:55.655349 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.655235 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfpdd\" (UniqueName: \"kubernetes.io/projected/c4d3bc42-3e10-42e7-9bf1-a8df381558b7-kube-api-access-mfpdd\") pod \"authorino-7498df8756-dw7g2\" (UID: \"c4d3bc42-3e10-42e7-9bf1-a8df381558b7\") " pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:31:55.656598 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.656571 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b6dnb"] Jun 02 19:31:55.667971 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.667944 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfpdd\" (UniqueName: \"kubernetes.io/projected/c4d3bc42-3e10-42e7-9bf1-a8df381558b7-kube-api-access-mfpdd\") pod \"authorino-7498df8756-dw7g2\" (UID: \"c4d3bc42-3e10-42e7-9bf1-a8df381558b7\") " pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:31:55.746840 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.746806 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:31:55.928110 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:55.927823 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-dw7g2"] Jun 02 19:31:55.931518 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:31:55.931489 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4d3bc42_3e10_42e7_9bf1_a8df381558b7.slice/crio-b29282d08d90a46a4a8ddcecd2c1c2591a15a255b25ea7599aebaacd90ea83b7 WatchSource:0}: Error finding container b29282d08d90a46a4a8ddcecd2c1c2591a15a255b25ea7599aebaacd90ea83b7: Status 404 returned error can't find the container with id b29282d08d90a46a4a8ddcecd2c1c2591a15a255b25ea7599aebaacd90ea83b7 Jun 02 19:31:56.322344 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:56.322274 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dw7g2" event={"ID":"c4d3bc42-3e10-42e7-9bf1-a8df381558b7","Type":"ContainerStarted","Data":"b29282d08d90a46a4a8ddcecd2c1c2591a15a255b25ea7599aebaacd90ea83b7"} Jun 02 19:31:56.324682 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:31:56.324624 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" event={"ID":"4eeb5065-daf1-44cc-83ad-96156622cdee","Type":"ContainerStarted","Data":"7fd74aaa5fef7a0c77c262fa32b39249487a52ae56f18827daa18062028db91d"} Jun 02 19:32:00.342816 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.342778 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" event={"ID":"095d7bdc-46c1-4f3a-b64e-5b427f2386e0","Type":"ContainerStarted","Data":"3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3"} Jun 02 19:32:00.343312 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.342966 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:32:00.344201 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.344167 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dw7g2" event={"ID":"c4d3bc42-3e10-42e7-9bf1-a8df381558b7","Type":"ContainerStarted","Data":"96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46"} Jun 02 19:32:00.345359 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.345334 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" event={"ID":"4eeb5065-daf1-44cc-83ad-96156622cdee","Type":"ContainerStarted","Data":"4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67"} Jun 02 19:32:00.363346 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.363272 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" podStartSLOduration=1.536995195 podStartE2EDuration="6.363251755s" podCreationTimestamp="2026-06-02 19:31:54 +0000 UTC" firstStartedPulling="2026-06-02 19:31:54.794051345 +0000 UTC m=+641.183096010" lastFinishedPulling="2026-06-02 19:31:59.620307889 +0000 UTC m=+646.009352570" observedRunningTime="2026-06-02 19:32:00.359577557 +0000 UTC m=+646.748622243" watchObservedRunningTime="2026-06-02 19:32:00.363251755 +0000 UTC m=+646.752296443" Jun 02 19:32:00.378665 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.378612 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-dw7g2" podStartSLOduration=1.683332186 podStartE2EDuration="5.378597888s" podCreationTimestamp="2026-06-02 19:31:55 +0000 UTC" firstStartedPulling="2026-06-02 19:31:55.933384284 +0000 UTC m=+642.322428956" lastFinishedPulling="2026-06-02 19:31:59.628649993 +0000 UTC m=+646.017694658" observedRunningTime="2026-06-02 19:32:00.377919481 +0000 UTC m=+646.766964169" watchObservedRunningTime="2026-06-02 19:32:00.378597888 +0000 UTC m=+646.767642574" Jun 02 19:32:00.392814 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.392755 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" podStartSLOduration=1.439176308 podStartE2EDuration="5.392735886s" podCreationTimestamp="2026-06-02 19:31:55 +0000 UTC" firstStartedPulling="2026-06-02 19:31:55.667551364 +0000 UTC m=+642.056596031" lastFinishedPulling="2026-06-02 19:31:59.621110944 +0000 UTC m=+646.010155609" observedRunningTime="2026-06-02 19:32:00.391943121 +0000 UTC m=+646.780987809" watchObservedRunningTime="2026-06-02 19:32:00.392735886 +0000 UTC m=+646.781780575" Jun 02 19:32:00.422528 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:00.422478 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b6dnb"] Jun 02 19:32:02.353087 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:02.353047 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" podUID="4eeb5065-daf1-44cc-83ad-96156622cdee" containerName="authorino" containerID="cri-o://4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67" gracePeriod=30 Jun 02 19:32:02.606134 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:02.606066 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:32:02.724356 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:02.724315 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8qk7\" (UniqueName: \"kubernetes.io/projected/4eeb5065-daf1-44cc-83ad-96156622cdee-kube-api-access-n8qk7\") pod \"4eeb5065-daf1-44cc-83ad-96156622cdee\" (UID: \"4eeb5065-daf1-44cc-83ad-96156622cdee\") " Jun 02 19:32:02.726408 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:02.726374 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eeb5065-daf1-44cc-83ad-96156622cdee-kube-api-access-n8qk7" (OuterVolumeSpecName: "kube-api-access-n8qk7") pod "4eeb5065-daf1-44cc-83ad-96156622cdee" (UID: "4eeb5065-daf1-44cc-83ad-96156622cdee"). InnerVolumeSpecName "kube-api-access-n8qk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:32:02.825741 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:02.825701 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8qk7\" (UniqueName: \"kubernetes.io/projected/4eeb5065-daf1-44cc-83ad-96156622cdee-kube-api-access-n8qk7\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:32:03.357319 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.357284 2572 generic.go:358] "Generic (PLEG): container finished" podID="4eeb5065-daf1-44cc-83ad-96156622cdee" containerID="4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67" exitCode=0 Jun 02 19:32:03.357762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.357329 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" Jun 02 19:32:03.357762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.357372 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" event={"ID":"4eeb5065-daf1-44cc-83ad-96156622cdee","Type":"ContainerDied","Data":"4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67"} Jun 02 19:32:03.357762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.357413 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b6dnb" event={"ID":"4eeb5065-daf1-44cc-83ad-96156622cdee","Type":"ContainerDied","Data":"7fd74aaa5fef7a0c77c262fa32b39249487a52ae56f18827daa18062028db91d"} Jun 02 19:32:03.357762 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.357449 2572 scope.go:117] "RemoveContainer" containerID="4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67" Jun 02 19:32:03.366096 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.366077 2572 scope.go:117] "RemoveContainer" containerID="4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67" Jun 02 19:32:03.366383 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:32:03.366366 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67\": container with ID starting with 4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67 not found: ID does not exist" containerID="4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67" Jun 02 19:32:03.366454 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.366391 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67"} err="failed to get container status \"4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67\": rpc error: code = NotFound desc = could not find container \"4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67\": container with ID starting with 4755e47964f54284df9dc964428fddcfcb55a0c0ba7b6b3a39be435003c8dd67 not found: ID does not exist" Jun 02 19:32:03.377558 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.377529 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b6dnb"] Jun 02 19:32:03.380392 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:03.380366 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b6dnb"] Jun 02 19:32:04.246380 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:04.246349 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eeb5065-daf1-44cc-83ad-96156622cdee" path="/var/lib/kubelet/pods/4eeb5065-daf1-44cc-83ad-96156622cdee/volumes" Jun 02 19:32:09.379843 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.379810 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:32:09.380242 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.380043 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" podUID="095d7bdc-46c1-4f3a-b64e-5b427f2386e0" containerName="limitador" containerID="cri-o://3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3" gracePeriod=30 Jun 02 19:32:09.380641 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.380623 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:32:09.934645 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.934619 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:32:09.985819 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.985736 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pcvz\" (UniqueName: \"kubernetes.io/projected/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-kube-api-access-8pcvz\") pod \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " Jun 02 19:32:09.985819 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.985797 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-config-file\") pod \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\" (UID: \"095d7bdc-46c1-4f3a-b64e-5b427f2386e0\") " Jun 02 19:32:09.986134 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.986111 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-config-file" (OuterVolumeSpecName: "config-file") pod "095d7bdc-46c1-4f3a-b64e-5b427f2386e0" (UID: "095d7bdc-46c1-4f3a-b64e-5b427f2386e0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:32:09.987745 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:09.987723 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-kube-api-access-8pcvz" (OuterVolumeSpecName: "kube-api-access-8pcvz") pod "095d7bdc-46c1-4f3a-b64e-5b427f2386e0" (UID: "095d7bdc-46c1-4f3a-b64e-5b427f2386e0"). InnerVolumeSpecName "kube-api-access-8pcvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:32:10.086650 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.086611 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pcvz\" (UniqueName: \"kubernetes.io/projected/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-kube-api-access-8pcvz\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:32:10.086650 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.086645 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/095d7bdc-46c1-4f3a-b64e-5b427f2386e0-config-file\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:32:10.382833 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.382797 2572 generic.go:358] "Generic (PLEG): container finished" podID="095d7bdc-46c1-4f3a-b64e-5b427f2386e0" containerID="3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3" exitCode=0 Jun 02 19:32:10.383247 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.382858 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" Jun 02 19:32:10.383247 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.382879 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" event={"ID":"095d7bdc-46c1-4f3a-b64e-5b427f2386e0","Type":"ContainerDied","Data":"3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3"} Jun 02 19:32:10.383247 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.382911 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mvqgv" event={"ID":"095d7bdc-46c1-4f3a-b64e-5b427f2386e0","Type":"ContainerDied","Data":"02d8f6d829f623f7f6ee4d64a92068e833dd4973dca6c5e1ca3897a655268498"} Jun 02 19:32:10.383247 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.382926 2572 scope.go:117] "RemoveContainer" containerID="3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3" Jun 02 19:32:10.391285 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.391266 2572 scope.go:117] "RemoveContainer" containerID="3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3" Jun 02 19:32:10.391594 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:32:10.391574 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3\": container with ID starting with 3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3 not found: ID does not exist" containerID="3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3" Jun 02 19:32:10.391635 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.391603 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3"} err="failed to get container status \"3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3\": rpc error: code = NotFound desc = could not find container \"3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3\": container with ID starting with 3ee3803d474e6bd91a320342c4f56acfb34f0497f2e792f51ff40937166041b3 not found: ID does not exist" Jun 02 19:32:10.399790 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.399767 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:32:10.403539 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.403516 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mvqgv"] Jun 02 19:32:10.496247 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496217 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-gr5v8"] Jun 02 19:32:10.496570 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496557 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095d7bdc-46c1-4f3a-b64e-5b427f2386e0" containerName="limitador" Jun 02 19:32:10.496629 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496572 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="095d7bdc-46c1-4f3a-b64e-5b427f2386e0" containerName="limitador" Jun 02 19:32:10.496629 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496586 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eeb5065-daf1-44cc-83ad-96156622cdee" containerName="authorino" Jun 02 19:32:10.496629 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496591 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eeb5065-daf1-44cc-83ad-96156622cdee" containerName="authorino" Jun 02 19:32:10.496728 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496656 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="095d7bdc-46c1-4f3a-b64e-5b427f2386e0" containerName="limitador" Jun 02 19:32:10.496728 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.496664 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="4eeb5065-daf1-44cc-83ad-96156622cdee" containerName="authorino" Jun 02 19:32:10.500940 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.500918 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.503334 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.503309 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 19:32:10.503507 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.503387 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ftjcx\"" Jun 02 19:32:10.507682 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.507652 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-gr5v8"] Jun 02 19:32:10.588484 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.588413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btghm\" (UniqueName: \"kubernetes.io/projected/f8e66228-05cd-4a7a-b682-329e4bf11c32-kube-api-access-btghm\") pod \"postgres-68c4fbbd6f-gr5v8\" (UID: \"f8e66228-05cd-4a7a-b682-329e4bf11c32\") " pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.588657 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.588551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f8e66228-05cd-4a7a-b682-329e4bf11c32-data\") pod \"postgres-68c4fbbd6f-gr5v8\" (UID: \"f8e66228-05cd-4a7a-b682-329e4bf11c32\") " pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.689726 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.689684 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f8e66228-05cd-4a7a-b682-329e4bf11c32-data\") pod \"postgres-68c4fbbd6f-gr5v8\" (UID: \"f8e66228-05cd-4a7a-b682-329e4bf11c32\") " pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.689930 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.689771 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btghm\" (UniqueName: \"kubernetes.io/projected/f8e66228-05cd-4a7a-b682-329e4bf11c32-kube-api-access-btghm\") pod \"postgres-68c4fbbd6f-gr5v8\" (UID: \"f8e66228-05cd-4a7a-b682-329e4bf11c32\") " pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.690156 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.690132 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f8e66228-05cd-4a7a-b682-329e4bf11c32-data\") pod \"postgres-68c4fbbd6f-gr5v8\" (UID: \"f8e66228-05cd-4a7a-b682-329e4bf11c32\") " pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.698407 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.698379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btghm\" (UniqueName: \"kubernetes.io/projected/f8e66228-05cd-4a7a-b682-329e4bf11c32-kube-api-access-btghm\") pod \"postgres-68c4fbbd6f-gr5v8\" (UID: \"f8e66228-05cd-4a7a-b682-329e4bf11c32\") " pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.813349 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.813272 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:10.943529 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:10.943499 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-gr5v8"] Jun 02 19:32:10.946085 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:32:10.946056 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e66228_05cd_4a7a_b682_329e4bf11c32.slice/crio-0e02b88aa4b0d1cf18cf420d29ed14721a9e3c6a24bd78b54968191e579cbd0b WatchSource:0}: Error finding container 0e02b88aa4b0d1cf18cf420d29ed14721a9e3c6a24bd78b54968191e579cbd0b: Status 404 returned error can't find the container with id 0e02b88aa4b0d1cf18cf420d29ed14721a9e3c6a24bd78b54968191e579cbd0b Jun 02 19:32:11.387666 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:11.387630 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" event={"ID":"f8e66228-05cd-4a7a-b682-329e4bf11c32","Type":"ContainerStarted","Data":"0e02b88aa4b0d1cf18cf420d29ed14721a9e3c6a24bd78b54968191e579cbd0b"} Jun 02 19:32:12.247075 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:12.247041 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="095d7bdc-46c1-4f3a-b64e-5b427f2386e0" path="/var/lib/kubelet/pods/095d7bdc-46c1-4f3a-b64e-5b427f2386e0/volumes" Jun 02 19:32:14.264705 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:14.264679 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 19:32:14.400080 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:14.400040 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" event={"ID":"f8e66228-05cd-4a7a-b682-329e4bf11c32","Type":"ContainerStarted","Data":"ee153637153349b96e8c1d586fcb4dd43820e53cb801eb3ad9e17d9a659d80d0"} Jun 02 19:32:14.400249 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:14.400105 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:14.417095 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:14.417043 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" podStartSLOduration=1.102421802 podStartE2EDuration="4.417026633s" podCreationTimestamp="2026-06-02 19:32:10 +0000 UTC" firstStartedPulling="2026-06-02 19:32:10.947611279 +0000 UTC m=+657.336655950" lastFinishedPulling="2026-06-02 19:32:14.262216111 +0000 UTC m=+660.651260781" observedRunningTime="2026-06-02 19:32:14.415725439 +0000 UTC m=+660.804770126" watchObservedRunningTime="2026-06-02 19:32:14.417026633 +0000 UTC m=+660.806071320" Jun 02 19:32:20.434528 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:20.434496 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-gr5v8" Jun 02 19:32:29.497604 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.497567 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-9hkzh"] Jun 02 19:32:29.624592 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.624553 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-9hkzh"] Jun 02 19:32:29.624754 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.624681 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" Jun 02 19:32:29.633401 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.633377 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 19:32:29.633556 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.633453 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 19:32:29.634393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.634376 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-6jv5m\"" Jun 02 19:32:29.761406 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.761321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgc58\" (UniqueName: \"kubernetes.io/projected/7b8b54dc-6468-4899-96f5-89be3f72da0e-kube-api-access-tgc58\") pod \"keycloak-operator-7864d68cbd-9hkzh\" (UID: \"7b8b54dc-6468-4899-96f5-89be3f72da0e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" Jun 02 19:32:29.861987 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.861946 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgc58\" (UniqueName: \"kubernetes.io/projected/7b8b54dc-6468-4899-96f5-89be3f72da0e-kube-api-access-tgc58\") pod \"keycloak-operator-7864d68cbd-9hkzh\" (UID: \"7b8b54dc-6468-4899-96f5-89be3f72da0e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" Jun 02 19:32:29.871467 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.871438 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgc58\" (UniqueName: \"kubernetes.io/projected/7b8b54dc-6468-4899-96f5-89be3f72da0e-kube-api-access-tgc58\") pod \"keycloak-operator-7864d68cbd-9hkzh\" (UID: \"7b8b54dc-6468-4899-96f5-89be3f72da0e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" Jun 02 19:32:29.935232 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:29.935190 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" Jun 02 19:32:30.072335 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:30.072294 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-9hkzh"] Jun 02 19:32:30.075489 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:32:30.075382 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8b54dc_6468_4899_96f5_89be3f72da0e.slice/crio-956bd030609deb51dfad10a0c8eaa89fd133fde78bd42812871a125c8d0ca11d WatchSource:0}: Error finding container 956bd030609deb51dfad10a0c8eaa89fd133fde78bd42812871a125c8d0ca11d: Status 404 returned error can't find the container with id 956bd030609deb51dfad10a0c8eaa89fd133fde78bd42812871a125c8d0ca11d Jun 02 19:32:30.455196 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:30.455117 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" event={"ID":"7b8b54dc-6468-4899-96f5-89be3f72da0e","Type":"ContainerStarted","Data":"956bd030609deb51dfad10a0c8eaa89fd133fde78bd42812871a125c8d0ca11d"} Jun 02 19:32:37.482512 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:37.482475 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" event={"ID":"7b8b54dc-6468-4899-96f5-89be3f72da0e","Type":"ContainerStarted","Data":"a7a11231dd44ca8eaa924afd8b9eeec29599b182931c3a42142305f4f7adfde8"} Jun 02 19:32:37.501534 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:32:37.501472 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-9hkzh" podStartSLOduration=2.125325359 podStartE2EDuration="8.501451861s" podCreationTimestamp="2026-06-02 19:32:29 +0000 UTC" firstStartedPulling="2026-06-02 19:32:30.077350161 +0000 UTC m=+676.466394827" lastFinishedPulling="2026-06-02 19:32:36.453476661 +0000 UTC m=+682.842521329" observedRunningTime="2026-06-02 19:32:37.498886431 +0000 UTC m=+683.887931117" watchObservedRunningTime="2026-06-02 19:32:37.501451861 +0000 UTC m=+683.890496549" Jun 02 19:33:17.075673 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.075629 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dr4mw"] Jun 02 19:33:17.085373 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.085337 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:17.092261 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.092191 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dr4mw"] Jun 02 19:33:17.181332 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.181290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvfgb\" (UniqueName: \"kubernetes.io/projected/0d00232d-7122-4535-acbb-e691225d87ec-kube-api-access-bvfgb\") pod \"authorino-8b475cf9f-dr4mw\" (UID: \"0d00232d-7122-4535-acbb-e691225d87ec\") " pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:17.282740 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.282691 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvfgb\" (UniqueName: \"kubernetes.io/projected/0d00232d-7122-4535-acbb-e691225d87ec-kube-api-access-bvfgb\") pod \"authorino-8b475cf9f-dr4mw\" (UID: \"0d00232d-7122-4535-acbb-e691225d87ec\") " pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:17.291679 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.291648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvfgb\" (UniqueName: \"kubernetes.io/projected/0d00232d-7122-4535-acbb-e691225d87ec-kube-api-access-bvfgb\") pod \"authorino-8b475cf9f-dr4mw\" (UID: \"0d00232d-7122-4535-acbb-e691225d87ec\") " pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:17.302899 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.302867 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dr4mw"] Jun 02 19:33:17.303115 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.303104 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:17.332518 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.332000 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c796d698d-ndsrs"] Jun 02 19:33:17.337141 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.337104 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:17.340984 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.340931 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c796d698d-ndsrs"] Jun 02 19:33:17.385638 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.384971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhwn\" (UniqueName: \"kubernetes.io/projected/e6b6e139-6d8e-4de4-a46c-16ba30aa6762-kube-api-access-cnhwn\") pod \"authorino-6c796d698d-ndsrs\" (UID: \"e6b6e139-6d8e-4de4-a46c-16ba30aa6762\") " pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:17.421203 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.421167 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c796d698d-ndsrs"] Jun 02 19:33:17.421552 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:33:17.421523 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cnhwn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6c796d698d-ndsrs" podUID="e6b6e139-6d8e-4de4-a46c-16ba30aa6762" Jun 02 19:33:17.445765 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.445725 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77b849cb64-w67bp"] Jun 02 19:33:17.448519 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.448491 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.451104 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.451080 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 19:33:17.459172 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.459145 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77b849cb64-w67bp"] Jun 02 19:33:17.475213 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.475190 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dr4mw"] Jun 02 19:33:17.477825 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:33:17.477783 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d00232d_7122_4535_acbb_e691225d87ec.slice/crio-e11b433d555c08ff7694724d00830ac62e87e01b7df814e4544098c17ab6f583 WatchSource:0}: Error finding container e11b433d555c08ff7694724d00830ac62e87e01b7df814e4544098c17ab6f583: Status 404 returned error can't find the container with id e11b433d555c08ff7694724d00830ac62e87e01b7df814e4544098c17ab6f583 Jun 02 19:33:17.486111 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.486079 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhwn\" (UniqueName: \"kubernetes.io/projected/e6b6e139-6d8e-4de4-a46c-16ba30aa6762-kube-api-access-cnhwn\") pod \"authorino-6c796d698d-ndsrs\" (UID: \"e6b6e139-6d8e-4de4-a46c-16ba30aa6762\") " pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:17.494378 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.494351 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhwn\" (UniqueName: \"kubernetes.io/projected/e6b6e139-6d8e-4de4-a46c-16ba30aa6762-kube-api-access-cnhwn\") pod \"authorino-6c796d698d-ndsrs\" (UID: \"e6b6e139-6d8e-4de4-a46c-16ba30aa6762\") " pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:17.586721 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.586634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9z2p\" (UniqueName: \"kubernetes.io/projected/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-kube-api-access-m9z2p\") pod \"authorino-77b849cb64-w67bp\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.586867 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.586748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-tls-cert\") pod \"authorino-77b849cb64-w67bp\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.622337 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.622303 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" event={"ID":"0d00232d-7122-4535-acbb-e691225d87ec","Type":"ContainerStarted","Data":"e11b433d555c08ff7694724d00830ac62e87e01b7df814e4544098c17ab6f583"} Jun 02 19:33:17.622337 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.622319 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:17.627504 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.627476 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:17.688043 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.688012 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnhwn\" (UniqueName: \"kubernetes.io/projected/e6b6e139-6d8e-4de4-a46c-16ba30aa6762-kube-api-access-cnhwn\") pod \"e6b6e139-6d8e-4de4-a46c-16ba30aa6762\" (UID: \"e6b6e139-6d8e-4de4-a46c-16ba30aa6762\") " Jun 02 19:33:17.688217 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.688124 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-tls-cert\") pod \"authorino-77b849cb64-w67bp\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.688217 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.688188 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9z2p\" (UniqueName: \"kubernetes.io/projected/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-kube-api-access-m9z2p\") pod \"authorino-77b849cb64-w67bp\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.690076 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.690046 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b6e139-6d8e-4de4-a46c-16ba30aa6762-kube-api-access-cnhwn" (OuterVolumeSpecName: "kube-api-access-cnhwn") pod "e6b6e139-6d8e-4de4-a46c-16ba30aa6762" (UID: "e6b6e139-6d8e-4de4-a46c-16ba30aa6762"). InnerVolumeSpecName "kube-api-access-cnhwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:33:17.690456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.690440 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-tls-cert\") pod \"authorino-77b849cb64-w67bp\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.695663 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.695645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9z2p\" (UniqueName: \"kubernetes.io/projected/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-kube-api-access-m9z2p\") pod \"authorino-77b849cb64-w67bp\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.759608 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.759574 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:33:17.788871 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.788812 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnhwn\" (UniqueName: \"kubernetes.io/projected/e6b6e139-6d8e-4de4-a46c-16ba30aa6762-kube-api-access-cnhwn\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:33:17.887689 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:17.887663 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77b849cb64-w67bp"] Jun 02 19:33:17.890220 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:33:17.890189 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca8d67e_e629_4c48_8949_9d0cd1121cd9.slice/crio-7743f075f675ece3c94065d6b52508646453d23ccd4880a8208a1c9b2287a8c1 WatchSource:0}: Error finding container 7743f075f675ece3c94065d6b52508646453d23ccd4880a8208a1c9b2287a8c1: Status 404 returned error can't find the container with id 7743f075f675ece3c94065d6b52508646453d23ccd4880a8208a1c9b2287a8c1 Jun 02 19:33:18.627509 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.627472 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" event={"ID":"0d00232d-7122-4535-acbb-e691225d87ec","Type":"ContainerStarted","Data":"6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a"} Jun 02 19:33:18.627957 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.627538 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" podUID="0d00232d-7122-4535-acbb-e691225d87ec" containerName="authorino" containerID="cri-o://6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a" gracePeriod=30 Jun 02 19:33:18.628909 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.628877 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77b849cb64-w67bp" event={"ID":"9ca8d67e-e629-4c48-8949-9d0cd1121cd9","Type":"ContainerStarted","Data":"25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025"} Jun 02 19:33:18.628909 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.628897 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c796d698d-ndsrs" Jun 02 19:33:18.628909 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.628910 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77b849cb64-w67bp" event={"ID":"9ca8d67e-e629-4c48-8949-9d0cd1121cd9","Type":"ContainerStarted","Data":"7743f075f675ece3c94065d6b52508646453d23ccd4880a8208a1c9b2287a8c1"} Jun 02 19:33:18.642908 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.642859 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" podStartSLOduration=1.221848682 podStartE2EDuration="1.642844069s" podCreationTimestamp="2026-06-02 19:33:17 +0000 UTC" firstStartedPulling="2026-06-02 19:33:17.479287716 +0000 UTC m=+723.868332384" lastFinishedPulling="2026-06-02 19:33:17.900283099 +0000 UTC m=+724.289327771" observedRunningTime="2026-06-02 19:33:18.641905854 +0000 UTC m=+725.030950539" watchObservedRunningTime="2026-06-02 19:33:18.642844069 +0000 UTC m=+725.031888756" Jun 02 19:33:18.664137 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.664095 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c796d698d-ndsrs"] Jun 02 19:33:18.667587 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.667561 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c796d698d-ndsrs"] Jun 02 19:33:18.681089 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.681039 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-77b849cb64-w67bp" podStartSLOduration=1.35794837 podStartE2EDuration="1.681025911s" podCreationTimestamp="2026-06-02 19:33:17 +0000 UTC" firstStartedPulling="2026-06-02 19:33:17.891578455 +0000 UTC m=+724.280623123" lastFinishedPulling="2026-06-02 19:33:18.214655999 +0000 UTC m=+724.603700664" observedRunningTime="2026-06-02 19:33:18.679568276 +0000 UTC m=+725.068612963" watchObservedRunningTime="2026-06-02 19:33:18.681025911 +0000 UTC m=+725.070070597" Jun 02 19:33:18.705832 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.705798 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-dw7g2"] Jun 02 19:33:18.706079 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.706056 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-dw7g2" podUID="c4d3bc42-3e10-42e7-9bf1-a8df381558b7" containerName="authorino" containerID="cri-o://96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46" gracePeriod=30 Jun 02 19:33:18.963079 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.963048 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:18.966402 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:18.966380 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:33:19.100961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.100930 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfpdd\" (UniqueName: \"kubernetes.io/projected/c4d3bc42-3e10-42e7-9bf1-a8df381558b7-kube-api-access-mfpdd\") pod \"c4d3bc42-3e10-42e7-9bf1-a8df381558b7\" (UID: \"c4d3bc42-3e10-42e7-9bf1-a8df381558b7\") " Jun 02 19:33:19.100961 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.100961 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvfgb\" (UniqueName: \"kubernetes.io/projected/0d00232d-7122-4535-acbb-e691225d87ec-kube-api-access-bvfgb\") pod \"0d00232d-7122-4535-acbb-e691225d87ec\" (UID: \"0d00232d-7122-4535-acbb-e691225d87ec\") " Jun 02 19:33:19.103101 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.103064 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4d3bc42-3e10-42e7-9bf1-a8df381558b7-kube-api-access-mfpdd" (OuterVolumeSpecName: "kube-api-access-mfpdd") pod "c4d3bc42-3e10-42e7-9bf1-a8df381558b7" (UID: "c4d3bc42-3e10-42e7-9bf1-a8df381558b7"). InnerVolumeSpecName "kube-api-access-mfpdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:33:19.103208 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.103098 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d00232d-7122-4535-acbb-e691225d87ec-kube-api-access-bvfgb" (OuterVolumeSpecName: "kube-api-access-bvfgb") pod "0d00232d-7122-4535-acbb-e691225d87ec" (UID: "0d00232d-7122-4535-acbb-e691225d87ec"). InnerVolumeSpecName "kube-api-access-bvfgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:33:19.202179 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.202094 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfpdd\" (UniqueName: \"kubernetes.io/projected/c4d3bc42-3e10-42e7-9bf1-a8df381558b7-kube-api-access-mfpdd\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:33:19.202179 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.202125 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvfgb\" (UniqueName: \"kubernetes.io/projected/0d00232d-7122-4535-acbb-e691225d87ec-kube-api-access-bvfgb\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:33:19.633494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.633460 2572 generic.go:358] "Generic (PLEG): container finished" podID="c4d3bc42-3e10-42e7-9bf1-a8df381558b7" containerID="96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46" exitCode=0 Jun 02 19:33:19.633923 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.633517 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dw7g2" Jun 02 19:33:19.633923 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.633554 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dw7g2" event={"ID":"c4d3bc42-3e10-42e7-9bf1-a8df381558b7","Type":"ContainerDied","Data":"96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46"} Jun 02 19:33:19.633923 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.633588 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dw7g2" event={"ID":"c4d3bc42-3e10-42e7-9bf1-a8df381558b7","Type":"ContainerDied","Data":"b29282d08d90a46a4a8ddcecd2c1c2591a15a255b25ea7599aebaacd90ea83b7"} Jun 02 19:33:19.633923 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.633605 2572 scope.go:117] "RemoveContainer" containerID="96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46" Jun 02 19:33:19.634816 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.634715 2572 generic.go:358] "Generic (PLEG): container finished" podID="0d00232d-7122-4535-acbb-e691225d87ec" containerID="6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a" exitCode=0 Jun 02 19:33:19.634816 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.634756 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" Jun 02 19:33:19.634816 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.634781 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" event={"ID":"0d00232d-7122-4535-acbb-e691225d87ec","Type":"ContainerDied","Data":"6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a"} Jun 02 19:33:19.634816 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.634805 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dr4mw" event={"ID":"0d00232d-7122-4535-acbb-e691225d87ec","Type":"ContainerDied","Data":"e11b433d555c08ff7694724d00830ac62e87e01b7df814e4544098c17ab6f583"} Jun 02 19:33:19.641901 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.641858 2572 scope.go:117] "RemoveContainer" containerID="96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46" Jun 02 19:33:19.642162 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:33:19.642140 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46\": container with ID starting with 96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46 not found: ID does not exist" containerID="96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46" Jun 02 19:33:19.642253 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.642176 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46"} err="failed to get container status \"96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46\": rpc error: code = NotFound desc = could not find container \"96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46\": container with ID starting with 96b5a76fc850bdaa1de2b3822db0e9b2efcabfe5110e7d1445b1803c50a6bd46 not found: ID does not exist" Jun 02 19:33:19.642253 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.642201 2572 scope.go:117] "RemoveContainer" containerID="6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a" Jun 02 19:33:19.649570 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.649556 2572 scope.go:117] "RemoveContainer" containerID="6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a" Jun 02 19:33:19.649800 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:33:19.649780 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a\": container with ID starting with 6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a not found: ID does not exist" containerID="6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a" Jun 02 19:33:19.649845 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.649807 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a"} err="failed to get container status \"6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a\": rpc error: code = NotFound desc = could not find container \"6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a\": container with ID starting with 6bcfb85cadc222f2e6bb0d5abb455054c65776b8ca500cd092e6504af40ad86a not found: ID does not exist" Jun 02 19:33:19.657531 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.657508 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-dw7g2"] Jun 02 19:33:19.661837 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.661815 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-dw7g2"] Jun 02 19:33:19.672048 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.672018 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dr4mw"] Jun 02 19:33:19.676139 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:19.676115 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dr4mw"] Jun 02 19:33:20.247331 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:20.247295 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d00232d-7122-4535-acbb-e691225d87ec" path="/var/lib/kubelet/pods/0d00232d-7122-4535-acbb-e691225d87ec/volumes" Jun 02 19:33:20.247731 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:20.247712 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4d3bc42-3e10-42e7-9bf1-a8df381558b7" path="/var/lib/kubelet/pods/c4d3bc42-3e10-42e7-9bf1-a8df381558b7/volumes" Jun 02 19:33:20.248047 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:33:20.248031 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b6e139-6d8e-4de4-a46c-16ba30aa6762" path="/var/lib/kubelet/pods/e6b6e139-6d8e-4de4-a46c-16ba30aa6762/volumes" Jun 02 19:34:46.784889 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.784807 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5955c69544-krf5l"] Jun 02 19:34:46.785351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.785212 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d00232d-7122-4535-acbb-e691225d87ec" containerName="authorino" Jun 02 19:34:46.785351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.785225 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d00232d-7122-4535-acbb-e691225d87ec" containerName="authorino" Jun 02 19:34:46.785351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.785242 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d3bc42-3e10-42e7-9bf1-a8df381558b7" containerName="authorino" Jun 02 19:34:46.785351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.785249 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d3bc42-3e10-42e7-9bf1-a8df381558b7" containerName="authorino" Jun 02 19:34:46.785351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.785301 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d00232d-7122-4535-acbb-e691225d87ec" containerName="authorino" Jun 02 19:34:46.785351 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.785312 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4d3bc42-3e10-42e7-9bf1-a8df381558b7" containerName="authorino" Jun 02 19:34:46.788532 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.788514 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.791146 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.791119 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 19:34:46.795589 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.795563 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5955c69544-krf5l"] Jun 02 19:34:46.858102 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.858061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6sft\" (UniqueName: \"kubernetes.io/projected/2cb8698f-1290-4732-8745-0b96f3de4214-kube-api-access-l6sft\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.858102 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.858110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cb8698f-1290-4732-8745-0b96f3de4214-tls-cert\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.858303 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.858190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8698f-1290-4732-8745-0b96f3de4214-oidc-ca\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.959682 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.959637 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6sft\" (UniqueName: \"kubernetes.io/projected/2cb8698f-1290-4732-8745-0b96f3de4214-kube-api-access-l6sft\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.959682 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.959685 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cb8698f-1290-4732-8745-0b96f3de4214-tls-cert\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.959946 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.959723 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8698f-1290-4732-8745-0b96f3de4214-oidc-ca\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.960308 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.960292 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8698f-1290-4732-8745-0b96f3de4214-oidc-ca\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.962211 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.962192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cb8698f-1290-4732-8745-0b96f3de4214-tls-cert\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:46.970731 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:46.970702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6sft\" (UniqueName: \"kubernetes.io/projected/2cb8698f-1290-4732-8745-0b96f3de4214-kube-api-access-l6sft\") pod \"authorino-5955c69544-krf5l\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:47.099512 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.099412 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:34:47.232707 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.232529 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5955c69544-krf5l"] Jun 02 19:34:47.235695 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:34:47.235648 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cb8698f_1290_4732_8745_0b96f3de4214.slice/crio-a99f8dbfa94d32d450586dedbd29c4833a5ebe1c92c7ffaac4bec32cdae46aae WatchSource:0}: Error finding container a99f8dbfa94d32d450586dedbd29c4833a5ebe1c92c7ffaac4bec32cdae46aae: Status 404 returned error can't find the container with id a99f8dbfa94d32d450586dedbd29c4833a5ebe1c92c7ffaac4bec32cdae46aae Jun 02 19:34:47.944299 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.944203 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5955c69544-krf5l" event={"ID":"2cb8698f-1290-4732-8745-0b96f3de4214","Type":"ContainerStarted","Data":"e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb"} Jun 02 19:34:47.944299 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.944251 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5955c69544-krf5l" event={"ID":"2cb8698f-1290-4732-8745-0b96f3de4214","Type":"ContainerStarted","Data":"a99f8dbfa94d32d450586dedbd29c4833a5ebe1c92c7ffaac4bec32cdae46aae"} Jun 02 19:34:47.967650 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.967580 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5955c69544-krf5l" podStartSLOduration=1.556983621 podStartE2EDuration="1.967562285s" podCreationTimestamp="2026-06-02 19:34:46 +0000 UTC" firstStartedPulling="2026-06-02 19:34:47.236892038 +0000 UTC m=+813.625936703" lastFinishedPulling="2026-06-02 19:34:47.647470696 +0000 UTC m=+814.036515367" observedRunningTime="2026-06-02 19:34:47.965776927 +0000 UTC m=+814.354821615" watchObservedRunningTime="2026-06-02 19:34:47.967562285 +0000 UTC m=+814.356606975" Jun 02 19:34:47.997957 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.997918 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77b849cb64-w67bp"] Jun 02 19:34:47.998209 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:47.998182 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-77b849cb64-w67bp" podUID="9ca8d67e-e629-4c48-8949-9d0cd1121cd9" containerName="authorino" containerID="cri-o://25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025" gracePeriod=30 Jun 02 19:34:48.249013 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.248989 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:34:48.272377 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.272345 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-tls-cert\") pod \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " Jun 02 19:34:48.272561 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.272440 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9z2p\" (UniqueName: \"kubernetes.io/projected/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-kube-api-access-m9z2p\") pod \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\" (UID: \"9ca8d67e-e629-4c48-8949-9d0cd1121cd9\") " Jun 02 19:34:48.274545 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.274507 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-kube-api-access-m9z2p" (OuterVolumeSpecName: "kube-api-access-m9z2p") pod "9ca8d67e-e629-4c48-8949-9d0cd1121cd9" (UID: "9ca8d67e-e629-4c48-8949-9d0cd1121cd9"). InnerVolumeSpecName "kube-api-access-m9z2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:34:48.282591 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.282561 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9ca8d67e-e629-4c48-8949-9d0cd1121cd9" (UID: "9ca8d67e-e629-4c48-8949-9d0cd1121cd9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:34:48.373922 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.373883 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9z2p\" (UniqueName: \"kubernetes.io/projected/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-kube-api-access-m9z2p\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:34:48.373922 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.373916 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca8d67e-e629-4c48-8949-9d0cd1121cd9-tls-cert\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:34:48.949126 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.949092 2572 generic.go:358] "Generic (PLEG): container finished" podID="9ca8d67e-e629-4c48-8949-9d0cd1121cd9" containerID="25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025" exitCode=0 Jun 02 19:34:48.949576 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.949138 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77b849cb64-w67bp" Jun 02 19:34:48.949576 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.949172 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77b849cb64-w67bp" event={"ID":"9ca8d67e-e629-4c48-8949-9d0cd1121cd9","Type":"ContainerDied","Data":"25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025"} Jun 02 19:34:48.949576 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.949201 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77b849cb64-w67bp" event={"ID":"9ca8d67e-e629-4c48-8949-9d0cd1121cd9","Type":"ContainerDied","Data":"7743f075f675ece3c94065d6b52508646453d23ccd4880a8208a1c9b2287a8c1"} Jun 02 19:34:48.949576 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.949215 2572 scope.go:117] "RemoveContainer" containerID="25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025" Jun 02 19:34:48.958116 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.958093 2572 scope.go:117] "RemoveContainer" containerID="25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025" Jun 02 19:34:48.958376 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:34:48.958359 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025\": container with ID starting with 25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025 not found: ID does not exist" containerID="25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025" Jun 02 19:34:48.958455 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.958384 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025"} err="failed to get container status \"25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025\": rpc error: code = NotFound desc = could not find container \"25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025\": container with ID starting with 25b20c3d81c708a2ff0100e0028bafa15198f4a427c0a217dcf7679676515025 not found: ID does not exist" Jun 02 19:34:48.971258 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.971232 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77b849cb64-w67bp"] Jun 02 19:34:48.975889 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:48.975867 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77b849cb64-w67bp"] Jun 02 19:34:50.246029 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:34:50.246000 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca8d67e-e629-4c48-8949-9d0cd1121cd9" path="/var/lib/kubelet/pods/9ca8d67e-e629-4c48-8949-9d0cd1121cd9/volumes" Jun 02 19:35:03.675050 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.675019 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6"] Jun 02 19:35:03.675532 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.675354 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca8d67e-e629-4c48-8949-9d0cd1121cd9" containerName="authorino" Jun 02 19:35:03.675532 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.675364 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca8d67e-e629-4c48-8949-9d0cd1121cd9" containerName="authorino" Jun 02 19:35:03.675532 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.675434 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ca8d67e-e629-4c48-8949-9d0cd1121cd9" containerName="authorino" Jun 02 19:35:03.678548 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.678523 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.681372 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.681347 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 19:35:03.681628 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.681607 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 19:35:03.682603 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.682581 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fhmd9\"" Jun 02 19:35:03.682815 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.682800 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 19:35:03.696796 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.696764 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6"] Jun 02 19:35:03.815494 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.815411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmjg\" (UniqueName: \"kubernetes.io/projected/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-kube-api-access-smmjg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.815686 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.815551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.815686 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.815585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.815772 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.815677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.815772 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.815721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.815772 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.815752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.916758 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.916716 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.916758 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.916764 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.916991 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.916797 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smmjg\" (UniqueName: \"kubernetes.io/projected/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-kube-api-access-smmjg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.916991 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.916828 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.916991 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.916846 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.916991 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.916896 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.917224 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.917197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.917286 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.917207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.917334 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.917284 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.919070 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.919050 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.919331 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.919311 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.928718 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.928645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmjg\" (UniqueName: \"kubernetes.io/projected/c8da05f3-f0a9-4db0-a866-bd502b06fe0a-kube-api-access-smmjg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6\" (UID: \"c8da05f3-f0a9-4db0-a866-bd502b06fe0a\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:03.989214 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:03.989174 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:04.130728 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:04.130692 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6"] Jun 02 19:35:04.133832 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:35:04.133802 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8da05f3_f0a9_4db0_a866_bd502b06fe0a.slice/crio-f8a46921c059ae981879f12f12eb8b80ed9be9ff65f352a45d16358396432f10 WatchSource:0}: Error finding container f8a46921c059ae981879f12f12eb8b80ed9be9ff65f352a45d16358396432f10: Status 404 returned error can't find the container with id f8a46921c059ae981879f12f12eb8b80ed9be9ff65f352a45d16358396432f10 Jun 02 19:35:05.006574 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:05.006539 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" event={"ID":"c8da05f3-f0a9-4db0-a866-bd502b06fe0a","Type":"ContainerStarted","Data":"f8a46921c059ae981879f12f12eb8b80ed9be9ff65f352a45d16358396432f10"} Jun 02 19:35:08.018955 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:08.018920 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" event={"ID":"c8da05f3-f0a9-4db0-a866-bd502b06fe0a","Type":"ContainerStarted","Data":"6a0e7df1fa1e2207e7f6ac596e2672f67fdd32abb4f6160a2214f99ea6d9672d"} Jun 02 19:35:09.023766 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:09.023732 2572 generic.go:358] "Generic (PLEG): container finished" podID="c8da05f3-f0a9-4db0-a866-bd502b06fe0a" containerID="6a0e7df1fa1e2207e7f6ac596e2672f67fdd32abb4f6160a2214f99ea6d9672d" exitCode=0 Jun 02 19:35:09.024280 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:09.023816 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" event={"ID":"c8da05f3-f0a9-4db0-a866-bd502b06fe0a","Type":"ContainerDied","Data":"6a0e7df1fa1e2207e7f6ac596e2672f67fdd32abb4f6160a2214f99ea6d9672d"} Jun 02 19:35:14.049489 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:14.049450 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" event={"ID":"c8da05f3-f0a9-4db0-a866-bd502b06fe0a","Type":"ContainerStarted","Data":"a6415fa91c2f14aa3ce0637ea6d1da0f3776a14618096bbb7dba656a00af0424"} Jun 02 19:35:14.069558 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:14.069509 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" podStartSLOduration=2.148820737 podStartE2EDuration="11.069493791s" podCreationTimestamp="2026-06-02 19:35:03 +0000 UTC" firstStartedPulling="2026-06-02 19:35:04.135600492 +0000 UTC m=+830.524645158" lastFinishedPulling="2026-06-02 19:35:13.056273548 +0000 UTC m=+839.445318212" observedRunningTime="2026-06-02 19:35:14.066925612 +0000 UTC m=+840.455970296" watchObservedRunningTime="2026-06-02 19:35:14.069493791 +0000 UTC m=+840.458538477" Jun 02 19:35:23.989513 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:23.989463 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:23.989513 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:23.989522 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:24.001889 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:24.001859 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:24.091610 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:24.091579 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6" Jun 02 19:35:30.802226 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.802190 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79"] Jun 02 19:35:30.817114 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.817082 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.817991 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.817963 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79"] Jun 02 19:35:30.819642 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.819623 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 19:35:30.864807 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.864770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jcwg\" (UniqueName: \"kubernetes.io/projected/53b32b76-0c83-4152-8a5c-ae956bb16e56-kube-api-access-8jcwg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.864985 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.864872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53b32b76-0c83-4152-8a5c-ae956bb16e56-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.864985 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.864903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.864985 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.864959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.864985 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.864981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.865119 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.865043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966140 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966103 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53b32b76-0c83-4152-8a5c-ae956bb16e56-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966140 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966140 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966170 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966201 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966257 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966290 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jcwg\" (UniqueName: \"kubernetes.io/projected/53b32b76-0c83-4152-8a5c-ae956bb16e56-kube-api-access-8jcwg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966641 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966588 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966641 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.966722 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.966667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.968469 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.968447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53b32b76-0c83-4152-8a5c-ae956bb16e56-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.968843 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.968821 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53b32b76-0c83-4152-8a5c-ae956bb16e56-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:30.975188 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:30.975164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jcwg\" (UniqueName: \"kubernetes.io/projected/53b32b76-0c83-4152-8a5c-ae956bb16e56-kube-api-access-8jcwg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79\" (UID: \"53b32b76-0c83-4152-8a5c-ae956bb16e56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:31.128146 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:31.128054 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:31.262595 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:31.262555 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79"] Jun 02 19:35:31.265102 ip-10-0-128-46 kubenswrapper[2572]: W0602 19:35:31.265068 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b32b76_0c83_4152_8a5c_ae956bb16e56.slice/crio-b75aa634ec063fd5433696c0995abf01ee574f0738dc3ae7c0f9ab37e94d3479 WatchSource:0}: Error finding container b75aa634ec063fd5433696c0995abf01ee574f0738dc3ae7c0f9ab37e94d3479: Status 404 returned error can't find the container with id b75aa634ec063fd5433696c0995abf01ee574f0738dc3ae7c0f9ab37e94d3479 Jun 02 19:35:32.108852 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:32.108816 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" event={"ID":"53b32b76-0c83-4152-8a5c-ae956bb16e56","Type":"ContainerStarted","Data":"6c37b857143cc94f3db1aaeebafa7b2ece44ce9daca2951b0ff1ec2dc2d0d6ee"} Jun 02 19:35:32.108852 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:32.108854 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" event={"ID":"53b32b76-0c83-4152-8a5c-ae956bb16e56","Type":"ContainerStarted","Data":"b75aa634ec063fd5433696c0995abf01ee574f0738dc3ae7c0f9ab37e94d3479"} Jun 02 19:35:33.113099 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:33.113062 2572 generic.go:358] "Generic (PLEG): container finished" podID="53b32b76-0c83-4152-8a5c-ae956bb16e56" containerID="6c37b857143cc94f3db1aaeebafa7b2ece44ce9daca2951b0ff1ec2dc2d0d6ee" exitCode=0 Jun 02 19:35:33.113603 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:33.113153 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" event={"ID":"53b32b76-0c83-4152-8a5c-ae956bb16e56","Type":"ContainerDied","Data":"6c37b857143cc94f3db1aaeebafa7b2ece44ce9daca2951b0ff1ec2dc2d0d6ee"} Jun 02 19:35:34.119928 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:34.119893 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" event={"ID":"53b32b76-0c83-4152-8a5c-ae956bb16e56","Type":"ContainerStarted","Data":"9f9fa9ebc23fd6f4c383d32c77f00ebba10c49f6c525aa74e63b0af6d1f9794f"} Jun 02 19:35:34.147664 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:34.147617 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" podStartSLOduration=3.8126384140000003 podStartE2EDuration="4.14760213s" podCreationTimestamp="2026-06-02 19:35:30 +0000 UTC" firstStartedPulling="2026-06-02 19:35:33.113798573 +0000 UTC m=+859.502843241" lastFinishedPulling="2026-06-02 19:35:33.448762288 +0000 UTC m=+859.837806957" observedRunningTime="2026-06-02 19:35:34.146584997 +0000 UTC m=+860.535629686" watchObservedRunningTime="2026-06-02 19:35:34.14760213 +0000 UTC m=+860.536646816" Jun 02 19:35:41.128457 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:41.128409 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:41.128457 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:41.128465 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:41.141393 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:41.141367 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:35:41.159733 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:35:41.159704 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79" Jun 02 19:36:14.188456 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:36:14.188360 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:36:14.188982 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:36:14.188812 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:38:01.909575 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:01.909490 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-664cc6cf7c-hklm6"] Jun 02 19:38:01.912611 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:01.912589 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:01.929872 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:01.929844 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-664cc6cf7c-hklm6"] Jun 02 19:38:02.018218 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.018182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fab2063-8b0f-49ad-babc-f3692a0b1484-tls-cert\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.018449 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.018232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s972j\" (UniqueName: \"kubernetes.io/projected/6fab2063-8b0f-49ad-babc-f3692a0b1484-kube-api-access-s972j\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.018449 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.018298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6fab2063-8b0f-49ad-babc-f3692a0b1484-oidc-ca\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.119394 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.119349 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fab2063-8b0f-49ad-babc-f3692a0b1484-tls-cert\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.119578 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.119405 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s972j\" (UniqueName: \"kubernetes.io/projected/6fab2063-8b0f-49ad-babc-f3692a0b1484-kube-api-access-s972j\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.119578 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.119491 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6fab2063-8b0f-49ad-babc-f3692a0b1484-oidc-ca\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.120071 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.120041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6fab2063-8b0f-49ad-babc-f3692a0b1484-oidc-ca\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.121813 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.121794 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fab2063-8b0f-49ad-babc-f3692a0b1484-tls-cert\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.128479 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.128454 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s972j\" (UniqueName: \"kubernetes.io/projected/6fab2063-8b0f-49ad-babc-f3692a0b1484-kube-api-access-s972j\") pod \"authorino-664cc6cf7c-hklm6\" (UID: \"6fab2063-8b0f-49ad-babc-f3692a0b1484\") " pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.221329 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.221242 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664cc6cf7c-hklm6" Jun 02 19:38:02.346357 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.346335 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-664cc6cf7c-hklm6"] Jun 02 19:38:02.351682 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.351658 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:38:02.630099 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:02.630056 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664cc6cf7c-hklm6" event={"ID":"6fab2063-8b0f-49ad-babc-f3692a0b1484","Type":"ContainerStarted","Data":"93ae06134fe2678277c487687aad411d54623bdaad8709feb671eacc48e444cd"} Jun 02 19:38:03.635040 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:03.635001 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664cc6cf7c-hklm6" event={"ID":"6fab2063-8b0f-49ad-babc-f3692a0b1484","Type":"ContainerStarted","Data":"ee4079262d106a8b8545a0f6d0fa35cf51de9c84ac52782441835b58b8178573"} Jun 02 19:38:03.659371 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:03.659324 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-664cc6cf7c-hklm6" podStartSLOduration=2.173831813 podStartE2EDuration="2.659309276s" podCreationTimestamp="2026-06-02 19:38:01 +0000 UTC" firstStartedPulling="2026-06-02 19:38:02.351837883 +0000 UTC m=+1008.740882548" lastFinishedPulling="2026-06-02 19:38:02.837315347 +0000 UTC m=+1009.226360011" observedRunningTime="2026-06-02 19:38:03.657671924 +0000 UTC m=+1010.046716611" watchObservedRunningTime="2026-06-02 19:38:03.659309276 +0000 UTC m=+1010.048353961" Jun 02 19:38:03.691589 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:03.691548 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5955c69544-krf5l"] Jun 02 19:38:03.691846 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:03.691818 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5955c69544-krf5l" podUID="2cb8698f-1290-4732-8745-0b96f3de4214" containerName="authorino" containerID="cri-o://e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb" gracePeriod=30 Jun 02 19:38:03.936521 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:03.936497 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:38:04.037090 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.037054 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8698f-1290-4732-8745-0b96f3de4214-oidc-ca\") pod \"2cb8698f-1290-4732-8745-0b96f3de4214\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " Jun 02 19:38:04.037254 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.037146 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cb8698f-1290-4732-8745-0b96f3de4214-tls-cert\") pod \"2cb8698f-1290-4732-8745-0b96f3de4214\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " Jun 02 19:38:04.037254 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.037179 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6sft\" (UniqueName: \"kubernetes.io/projected/2cb8698f-1290-4732-8745-0b96f3de4214-kube-api-access-l6sft\") pod \"2cb8698f-1290-4732-8745-0b96f3de4214\" (UID: \"2cb8698f-1290-4732-8745-0b96f3de4214\") " Jun 02 19:38:04.039228 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.039198 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb8698f-1290-4732-8745-0b96f3de4214-kube-api-access-l6sft" (OuterVolumeSpecName: "kube-api-access-l6sft") pod "2cb8698f-1290-4732-8745-0b96f3de4214" (UID: "2cb8698f-1290-4732-8745-0b96f3de4214"). InnerVolumeSpecName "kube-api-access-l6sft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:38:04.041956 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.041930 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb8698f-1290-4732-8745-0b96f3de4214-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "2cb8698f-1290-4732-8745-0b96f3de4214" (UID: "2cb8698f-1290-4732-8745-0b96f3de4214"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:38:04.046899 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.046873 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb8698f-1290-4732-8745-0b96f3de4214-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2cb8698f-1290-4732-8745-0b96f3de4214" (UID: "2cb8698f-1290-4732-8745-0b96f3de4214"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:38:04.138171 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.138142 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cb8698f-1290-4732-8745-0b96f3de4214-tls-cert\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:38:04.138171 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.138171 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6sft\" (UniqueName: \"kubernetes.io/projected/2cb8698f-1290-4732-8745-0b96f3de4214-kube-api-access-l6sft\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:38:04.138323 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.138183 2572 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8698f-1290-4732-8745-0b96f3de4214-oidc-ca\") on node \"ip-10-0-128-46.ec2.internal\" DevicePath \"\"" Jun 02 19:38:04.639815 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.639737 2572 generic.go:358] "Generic (PLEG): container finished" podID="2cb8698f-1290-4732-8745-0b96f3de4214" containerID="e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb" exitCode=0 Jun 02 19:38:04.639815 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.639790 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5955c69544-krf5l" Jun 02 19:38:04.640287 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.639822 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5955c69544-krf5l" event={"ID":"2cb8698f-1290-4732-8745-0b96f3de4214","Type":"ContainerDied","Data":"e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb"} Jun 02 19:38:04.640287 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.639865 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5955c69544-krf5l" event={"ID":"2cb8698f-1290-4732-8745-0b96f3de4214","Type":"ContainerDied","Data":"a99f8dbfa94d32d450586dedbd29c4833a5ebe1c92c7ffaac4bec32cdae46aae"} Jun 02 19:38:04.640287 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.639880 2572 scope.go:117] "RemoveContainer" containerID="e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb" Jun 02 19:38:04.648112 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.648095 2572 scope.go:117] "RemoveContainer" containerID="e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb" Jun 02 19:38:04.648385 ip-10-0-128-46 kubenswrapper[2572]: E0602 19:38:04.648367 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb\": container with ID starting with e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb not found: ID does not exist" containerID="e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb" Jun 02 19:38:04.648713 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.648392 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb"} err="failed to get container status \"e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb\": rpc error: code = NotFound desc = could not find container \"e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb\": container with ID starting with e6df8aa897f15cee9332412e6c5c8fd8d2f6b58958dc0d118ac9b24a2253c9bb not found: ID does not exist" Jun 02 19:38:04.658255 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.658233 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5955c69544-krf5l"] Jun 02 19:38:04.671319 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:04.671293 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5955c69544-krf5l"] Jun 02 19:38:06.246785 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:38:06.246750 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb8698f-1290-4732-8745-0b96f3de4214" path="/var/lib/kubelet/pods/2cb8698f-1290-4732-8745-0b96f3de4214/volumes" Jun 02 19:41:14.215101 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:41:14.215068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:41:14.216534 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:41:14.216513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:46:14.241314 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:46:14.241284 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:46:14.243656 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:46:14.243632 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:51:14.266138 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:51:14.266109 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:51:14.268859 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:51:14.268838 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:56:14.296770 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:56:14.296735 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 19:56:14.300360 ip-10-0-128-46 kubenswrapper[2572]: I0602 19:56:14.300343 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 20:01:11.631284 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:11.631245 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-664cc6cf7c-hklm6_6fab2063-8b0f-49ad-babc-f3692a0b1484/authorino/0.log" Jun 02 20:01:14.322147 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:14.322035 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 20:01:14.326958 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:14.326937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 20:01:17.583825 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:17.583800 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5889499b-wcf2f_b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf/copy-manifests/0.log" Jun 02 20:01:17.602083 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:17.602043 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5889499b-wcf2f_b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf/manager/0.log" Jun 02 20:01:17.713891 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:17.713860 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-gr5v8_f8e66228-05cd-4a7a-b682-329e4bf11c32/postgres/0.log" Jun 02 20:01:18.982203 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:18.982166 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-664cc6cf7c-hklm6_6fab2063-8b0f-49ad-babc-f3692a0b1484/authorino/0.log" Jun 02 20:01:20.469219 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:20.469187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-897b5b6bb-5bpt4_59107e56-2c3e-4272-9de6-4d15ade2abb7/kube-auth-proxy/0.log" Jun 02 20:01:21.450686 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:21.450651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6_c8da05f3-f0a9-4db0-a866-bd502b06fe0a/storage-initializer/0.log" Jun 02 20:01:21.459045 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:21.459019 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-fvbr6_c8da05f3-f0a9-4db0-a866-bd502b06fe0a/main/0.log" Jun 02 20:01:21.717121 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:21.717039 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79_53b32b76-0c83-4152-8a5c-ae956bb16e56/storage-initializer/0.log" Jun 02 20:01:21.725267 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:21.725229 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9kmb79_53b32b76-0c83-4152-8a5c-ae956bb16e56/main/0.log" Jun 02 20:01:29.563537 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:29.563507 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zlvlh_62b47b5d-5386-4329-86ea-b6ba0db81794/global-pull-secret-syncer/0.log" Jun 02 20:01:29.622381 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:29.622346 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4x7xs_236b6c1c-bfd6-4ffc-b8af-91faa1ea0621/konnectivity-agent/0.log" Jun 02 20:01:29.731160 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:29.731126 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-46.ec2.internal_549a9d2e531584bc93f5268da0f94a1c/haproxy/0.log" Jun 02 20:01:34.096824 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:34.096745 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-664cc6cf7c-hklm6_6fab2063-8b0f-49ad-babc-f3692a0b1484/authorino/0.log" Jun 02 20:01:35.896717 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:35.896673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-njrdt_d4777232-f2dc-4ec9-a858-19b0fe75c16b/cluster-monitoring-operator/0.log" Jun 02 20:01:35.926462 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:35.926405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-9nm68_825bcd1e-1a91-42f6-862b-efddd97ec99a/kube-state-metrics/0.log" Jun 02 20:01:35.949588 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:35.949558 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-9nm68_825bcd1e-1a91-42f6-862b-efddd97ec99a/kube-rbac-proxy-main/0.log" Jun 02 20:01:35.974703 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:35.974679 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-9nm68_825bcd1e-1a91-42f6-862b-efddd97ec99a/kube-rbac-proxy-self/0.log" Jun 02 20:01:36.035572 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.035489 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-w2gzt_a67e591f-40fa-4af6-a03a-528d0cfba948/monitoring-plugin/0.log" Jun 02 20:01:36.222824 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.222789 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-smm4w_8a720788-d5b9-4c82-a1a6-af070cf2f574/node-exporter/0.log" Jun 02 20:01:36.248516 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.248494 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-smm4w_8a720788-d5b9-4c82-a1a6-af070cf2f574/kube-rbac-proxy/0.log" Jun 02 20:01:36.286259 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.286187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-smm4w_8a720788-d5b9-4c82-a1a6-af070cf2f574/init-textfile/0.log" Jun 02 20:01:36.425078 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.425051 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/prometheus/0.log" Jun 02 20:01:36.451714 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.451688 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/config-reloader/0.log" Jun 02 20:01:36.477129 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.477101 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/thanos-sidecar/0.log" Jun 02 20:01:36.501393 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.501348 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/kube-rbac-proxy-web/0.log" Jun 02 20:01:36.526526 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.526497 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/kube-rbac-proxy/0.log" Jun 02 20:01:36.549024 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.548955 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/kube-rbac-proxy-thanos/0.log" Jun 02 20:01:36.577106 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.577079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3cebb08-1adb-4acb-b796-bf06df7991fb/init-config-reloader/0.log" Jun 02 20:01:36.607349 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.607305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qvdxn_7255256b-4bde-4951-86e5-cdc5a2b1e173/prometheus-operator/0.log" Jun 02 20:01:36.629501 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.629467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qvdxn_7255256b-4bde-4951-86e5-cdc5a2b1e173/kube-rbac-proxy/0.log" Jun 02 20:01:36.657068 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:36.657035 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-9kw8h_d7e4cf5f-f226-4620-907b-a83128a3753a/prometheus-operator-admission-webhook/0.log" Jun 02 20:01:40.349820 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.349786 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4"] Jun 02 20:01:40.350277 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.350137 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb8698f-1290-4732-8745-0b96f3de4214" containerName="authorino" Jun 02 20:01:40.350277 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.350147 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb8698f-1290-4732-8745-0b96f3de4214" containerName="authorino" Jun 02 20:01:40.350277 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.350219 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cb8698f-1290-4732-8745-0b96f3de4214" containerName="authorino" Jun 02 20:01:40.353353 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.353336 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.356142 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.356120 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-chkxm\"/\"openshift-service-ca.crt\"" Jun 02 20:01:40.356270 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.356122 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-chkxm\"/\"kube-root-ca.crt\"" Jun 02 20:01:40.357122 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.357101 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-chkxm\"/\"default-dockercfg-wmdjg\"" Jun 02 20:01:40.360758 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.360413 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4"] Jun 02 20:01:40.362646 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.362623 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9z75\" (UniqueName: \"kubernetes.io/projected/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-kube-api-access-t9z75\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.362747 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.362662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-podres\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.362747 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.362727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-sys\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.362863 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.362765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-proc\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.362863 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.362798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-lib-modules\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.463852 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.463822 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-sys\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464015 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.463874 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-proc\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464015 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.463934 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-lib-modules\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464015 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.463946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-sys\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464015 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.463948 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-proc\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464015 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.463977 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9z75\" (UniqueName: \"kubernetes.io/projected/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-kube-api-access-t9z75\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464185 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.464046 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-podres\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464185 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.464109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-lib-modules\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.464185 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.464167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-podres\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.472707 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.472683 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9z75\" (UniqueName: \"kubernetes.io/projected/ffa28ba1-8c44-4f45-a4c1-621dde7c982f-kube-api-access-t9z75\") pod \"perf-node-gather-daemonset-wk7x4\" (UID: \"ffa28ba1-8c44-4f45-a4c1-621dde7c982f\") " pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.664060 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.663971 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:40.676343 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.676315 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9c4jw_af2cc218-4eaf-407a-984d-baf995c6d579/dns/0.log" Jun 02 20:01:40.721311 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.721241 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9c4jw_af2cc218-4eaf-407a-984d-baf995c6d579/kube-rbac-proxy/0.log" Jun 02 20:01:40.797541 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.797509 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4"] Jun 02 20:01:40.800875 ip-10-0-128-46 kubenswrapper[2572]: W0602 20:01:40.800841 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podffa28ba1_8c44_4f45_a4c1_621dde7c982f.slice/crio-149466a4fd3ae76d879cee3e2e5f3da518a90a22cf6cff0d6a8383fcb097a5e4 WatchSource:0}: Error finding container 149466a4fd3ae76d879cee3e2e5f3da518a90a22cf6cff0d6a8383fcb097a5e4: Status 404 returned error can't find the container with id 149466a4fd3ae76d879cee3e2e5f3da518a90a22cf6cff0d6a8383fcb097a5e4 Jun 02 20:01:40.802398 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.802380 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:01:40.823769 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:40.823747 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dghj7_a22849c8-c59f-4dca-967d-8aabec2eff68/dns-node-resolver/0.log" Jun 02 20:01:41.449148 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:41.449103 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" event={"ID":"ffa28ba1-8c44-4f45-a4c1-621dde7c982f","Type":"ContainerStarted","Data":"89befed647ec1a1b88547effa2059173ef3fe89af240775a6a67bb433afb2563"} Jun 02 20:01:41.449148 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:41.449149 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" event={"ID":"ffa28ba1-8c44-4f45-a4c1-621dde7c982f","Type":"ContainerStarted","Data":"149466a4fd3ae76d879cee3e2e5f3da518a90a22cf6cff0d6a8383fcb097a5e4"} Jun 02 20:01:41.449570 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:41.449249 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:41.457147 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:41.457118 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w29g5_21362d88-840e-495d-8b90-dcd5b39600f1/node-ca/0.log" Jun 02 20:01:41.466563 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:41.466519 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" podStartSLOduration=1.466504544 podStartE2EDuration="1.466504544s" podCreationTimestamp="2026-06-02 20:01:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:01:41.465412181 +0000 UTC m=+2427.854456868" watchObservedRunningTime="2026-06-02 20:01:41.466504544 +0000 UTC m=+2427.855549231" Jun 02 20:01:42.489059 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:42.489022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-897b5b6bb-5bpt4_59107e56-2c3e-4272-9de6-4d15ade2abb7/kube-auth-proxy/0.log" Jun 02 20:01:43.382222 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:43.382188 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8dkrp_4e4bd9c7-90df-498e-9e13-aa8ec3c3d7a3/serve-healthcheck-canary/0.log" Jun 02 20:01:43.969856 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:43.969823 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-7kt78_27b15327-69d9-431d-b331-9d6f1dae6888/insights-operator/0.log" Jun 02 20:01:43.970344 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:43.970241 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-7kt78_27b15327-69d9-431d-b331-9d6f1dae6888/insights-operator/1.log" Jun 02 20:01:44.087204 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:44.087181 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dckvk_5c11a8f9-dd13-4c58-8e5a-6bb0990293d9/kube-rbac-proxy/0.log" Jun 02 20:01:44.108296 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:44.108267 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dckvk_5c11a8f9-dd13-4c58-8e5a-6bb0990293d9/exporter/0.log" Jun 02 20:01:44.136820 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:44.136792 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dckvk_5c11a8f9-dd13-4c58-8e5a-6bb0990293d9/extractor/0.log" Jun 02 20:01:46.909996 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:46.909954 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5889499b-wcf2f_b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf/manager/0.log" Jun 02 20:01:46.935634 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:46.935607 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5889499b-wcf2f_b23bd30f-071e-4ca4-a5a5-7bef48e8ebbf/copy-manifests/0.log" Jun 02 20:01:46.977962 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:46.977927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-gr5v8_f8e66228-05cd-4a7a-b682-329e4bf11c32/postgres/0.log" Jun 02 20:01:47.462260 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:47.462233 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-chkxm/perf-node-gather-daemonset-wk7x4" Jun 02 20:01:48.289084 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:48.289055 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77ccbc7d9-kl4nk_c6695574-7c69-45db-b256-cd4921a81de0/manager/0.log" Jun 02 20:01:53.303344 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:53.303309 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-ksldv_c4806e8d-2374-40de-9b4e-d885178e7cc1/migrator/0.log" Jun 02 20:01:53.327324 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:53.327291 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-ksldv_c4806e8d-2374-40de-9b4e-d885178e7cc1/graceful-termination/0.log" Jun 02 20:01:54.827211 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.827183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/kube-multus-additional-cni-plugins/0.log" Jun 02 20:01:54.849980 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.849949 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/egress-router-binary-copy/0.log" Jun 02 20:01:54.871695 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.871671 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/cni-plugins/0.log" Jun 02 20:01:54.898402 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.898370 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/bond-cni-plugin/0.log" Jun 02 20:01:54.925563 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.925522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/routeoverride-cni/0.log" Jun 02 20:01:54.941583 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.941556 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/whereabouts-cni-bincopy/0.log" Jun 02 20:01:54.970369 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:54.970331 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzd65_805fa8c7-d03a-4984-b55a-a2eee56b71af/whereabouts-cni/0.log" Jun 02 20:01:55.503172 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:55.503142 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zr5bx_107fb181-367b-4639-bd0d-30f53cf8e643/kube-multus/0.log" Jun 02 20:01:55.632010 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:55.631976 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wls57_e23bb9ac-98b9-4039-9dec-4c57e10592bc/network-metrics-daemon/0.log" Jun 02 20:01:55.653001 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:55.652959 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wls57_e23bb9ac-98b9-4039-9dec-4c57e10592bc/kube-rbac-proxy/0.log" Jun 02 20:01:57.116018 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.115986 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-controller/0.log" Jun 02 20:01:57.134232 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.134195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/0.log" Jun 02 20:01:57.156038 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.156008 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/ovn-acl-logging/1.log" Jun 02 20:01:57.179435 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.179393 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/kube-rbac-proxy-node/0.log" Jun 02 20:01:57.202012 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.201985 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 20:01:57.219323 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.219281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/northd/0.log" Jun 02 20:01:57.239141 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.239113 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/nbdb/0.log" Jun 02 20:01:57.260679 ip-10-0-128-46 kubenswrapper[2572]: I0602 20:01:57.260649 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgp2k_a9cbc51d-5fed-4be1-8115-05c3844dba75/sbdb/0.log"