May 21 17:30:00.259827 ip-10-0-130-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 17:30:00.259839 ip-10-0-130-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 17:30:00.259846 ip-10-0-130-70 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 17:30:00.260106 ip-10-0-130-70 systemd[1]: Failed to start Kubernetes Kubelet. May 21 17:30:11.564244 ip-10-0-130-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 17:30:11.564261 ip-10-0-130-70 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 542b8b5a26634f2596e3360cec71d141 -- May 21 17:32:28.435134 ip-10-0-130-70 systemd[1]: Starting Kubernetes Kubelet... May 21 17:32:28.937607 ip-10-0-130-70 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:32:28.937607 ip-10-0-130-70 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 17:32:28.937607 ip-10-0-130-70 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:32:28.937607 ip-10-0-130-70 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 17:32:28.937607 ip-10-0-130-70 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 17:32:28.941109 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.940977 2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 17:32:28.945031 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945015 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:28.945031 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945030 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945035 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945038 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945041 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945045 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945048 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945051 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945054 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945057 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945059 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945062 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945065 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945068 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945071 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945073 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945076 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945079 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945082 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945085 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945088 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:28.945101 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945091 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945093 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945096 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945098 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945101 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945103 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945106 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945109 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945112 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945115 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945118 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945121 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945124 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945128 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945130 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945133 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945135 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945138 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945141 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945145 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:28.945584 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945149 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945151 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945154 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945157 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945160 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945162 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945165 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945168 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945170 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945173 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945175 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945178 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945180 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945183 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945186 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945188 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945193 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945197 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945200 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:28.946134 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945203 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945205 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945208 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945210 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945213 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945218 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945221 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945223 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945226 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945228 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945231 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945233 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945236 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945239 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945242 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945244 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945247 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945249 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945252 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:28.946609 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945255 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945258 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945261 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945263 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945266 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945268 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.945271 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946562 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946569 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946572 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946576 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946579 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946582 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946585 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946587 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946591 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946594 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946596 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946599 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:28.947091 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946602 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946605 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946607 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946610 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946613 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946616 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946619 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946622 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946624 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946627 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946630 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946632 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946634 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946637 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946640 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946643 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946645 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946647 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946650 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:28.947555 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946653 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946655 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946658 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946660 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946663 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946666 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946668 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946671 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946673 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946675 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946678 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946681 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946683 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946686 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946689 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946691 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946694 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946696 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946699 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946701 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:28.948114 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946704 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946706 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946709 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946711 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946714 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946716 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946720 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946724 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946727 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946730 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946732 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946735 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946738 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946741 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946743 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946746 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946748 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946751 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946753 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:28.948611 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946756 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946759 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946761 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946764 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946766 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946769 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946771 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946774 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946777 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946779 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946782 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946784 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946787 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946789 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946793 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.946797 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946886 2551 flags.go:64] FLAG: --address="0.0.0.0" May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946894 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946901 2551 flags.go:64] FLAG: --anonymous-auth="true" May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946905 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946910 2551 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 17:32:28.949136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946913 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946918 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946922 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946926 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946929 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946933 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946936 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946939 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946942 2551 flags.go:64] FLAG: --cgroup-root="" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946946 2551 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946949 2551 flags.go:64] FLAG: --client-ca-file="" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946952 2551 flags.go:64] FLAG: --cloud-config="" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946954 2551 flags.go:64] FLAG: --cloud-provider="external" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946957 2551 flags.go:64] FLAG: --cluster-dns="[]" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946961 2551 flags.go:64] FLAG: --cluster-domain="" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946964 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946967 2551 flags.go:64] FLAG: --config-dir="" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946970 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946973 2551 flags.go:64] FLAG: --container-log-max-files="5" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946977 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946980 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946983 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946987 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946992 2551 flags.go:64] FLAG: --contention-profiling="false" May 21 17:32:28.949655 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946995 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.946998 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947002 2551 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947005 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947010 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947013 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947016 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947019 2551 flags.go:64] FLAG: --enable-load-reader="false" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947022 2551 flags.go:64] FLAG: --enable-server="true" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947025 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947030 2551 flags.go:64] FLAG: --event-burst="100" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947033 2551 flags.go:64] FLAG: --event-qps="50" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947036 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947039 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947058 2551 flags.go:64] FLAG: --eviction-hard="" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947062 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947066 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947069 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947072 2551 flags.go:64] FLAG: --eviction-soft="" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947075 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947078 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947081 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947084 2551 flags.go:64] FLAG: --experimental-mounter-path="" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947087 2551 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947089 2551 flags.go:64] FLAG: --fail-swap-on="true" May 21 17:32:28.950254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947092 2551 flags.go:64] FLAG: --feature-gates="" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947096 2551 flags.go:64] FLAG: --file-check-frequency="20s" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947100 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947103 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947107 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947109 2551 flags.go:64] FLAG: --healthz-port="10248" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947114 2551 flags.go:64] FLAG: --help="false" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947117 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-130-70.ec2.internal" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947120 2551 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947123 2551 flags.go:64] FLAG: --http-check-frequency="20s" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947127 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947130 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947134 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947137 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947140 2551 flags.go:64] FLAG: --image-service-endpoint="" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947143 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947145 2551 flags.go:64] FLAG: --kube-api-burst="100" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947148 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947151 2551 flags.go:64] FLAG: --kube-api-qps="50" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947154 2551 flags.go:64] FLAG: --kube-reserved="" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947157 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947160 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947163 2551 flags.go:64] FLAG: --kubelet-cgroups="" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947166 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 17:32:28.950869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947168 2551 flags.go:64] FLAG: --lock-file="" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947171 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947174 2551 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947177 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947182 2551 flags.go:64] FLAG: --log-json-split-stream="false" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947185 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947188 2551 flags.go:64] FLAG: --log-text-split-stream="false" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947191 2551 flags.go:64] FLAG: --logging-format="text" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947194 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947197 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947200 2551 flags.go:64] FLAG: --manifest-url="" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947203 2551 flags.go:64] FLAG: --manifest-url-header="" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947207 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947212 2551 flags.go:64] FLAG: --max-open-files="1000000" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947217 2551 flags.go:64] FLAG: --max-pods="110" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947220 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947223 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947226 2551 flags.go:64] FLAG: --memory-manager-policy="None" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947229 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947234 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947237 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947240 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947247 2551 flags.go:64] FLAG: --node-status-max-images="50" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947250 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947252 2551 flags.go:64] FLAG: --oom-score-adj="-999" May 21 17:32:28.951453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947256 2551 flags.go:64] FLAG: --pod-cidr="" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947258 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947264 2551 flags.go:64] FLAG: --pod-manifest-path="" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947267 2551 flags.go:64] FLAG: --pod-max-pids="-1" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947270 2551 flags.go:64] FLAG: --pods-per-core="0" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947273 2551 flags.go:64] FLAG: --port="10250" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947276 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947279 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ddd902d10db0467a" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947282 2551 flags.go:64] FLAG: --qos-reserved="" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947285 2551 flags.go:64] FLAG: --read-only-port="10255" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947288 2551 flags.go:64] FLAG: --register-node="true" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947291 2551 flags.go:64] FLAG: --register-schedulable="true" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947294 2551 flags.go:64] FLAG: --register-with-taints="" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947298 2551 flags.go:64] FLAG: --registry-burst="10" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947300 2551 flags.go:64] FLAG: --registry-qps="5" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947303 2551 flags.go:64] FLAG: --reserved-cpus="" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947306 2551 flags.go:64] FLAG: --reserved-memory="" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947310 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947312 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947316 2551 flags.go:64] FLAG: --rotate-certificates="false" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947318 2551 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947323 2551 flags.go:64] FLAG: --runonce="false" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947326 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947330 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947333 2551 flags.go:64] FLAG: --seccomp-default="false" May 21 17:32:28.952075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947335 2551 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947338 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947342 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947345 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947348 2551 flags.go:64] FLAG: --storage-driver-password="root" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947351 2551 flags.go:64] FLAG: --storage-driver-secure="false" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947354 2551 flags.go:64] FLAG: --storage-driver-table="stats" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947357 2551 flags.go:64] FLAG: --storage-driver-user="root" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947359 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947362 2551 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947365 2551 flags.go:64] FLAG: --system-cgroups="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947368 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947374 2551 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947376 2551 flags.go:64] FLAG: --tls-cert-file="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947379 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947383 2551 flags.go:64] FLAG: --tls-min-version="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947386 2551 flags.go:64] FLAG: --tls-private-key-file="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947389 2551 flags.go:64] FLAG: --topology-manager-policy="none" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947391 2551 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947394 2551 flags.go:64] FLAG: --topology-manager-scope="container" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947397 2551 flags.go:64] FLAG: --v="2" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947401 2551 flags.go:64] FLAG: --version="false" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947405 2551 flags.go:64] FLAG: --vmodule="" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947409 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.947413 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 17:32:28.952676 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947504 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947508 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947512 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947516 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947518 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947521 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947524 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947526 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947529 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947531 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947534 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947537 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947539 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947542 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947544 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947547 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947550 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947552 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947555 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:28.953284 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947557 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947560 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947563 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947566 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947568 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947571 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947574 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947576 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947581 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947584 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947587 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947590 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947592 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947595 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947597 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947600 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947603 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947606 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947608 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947611 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:28.953741 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947614 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947616 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947619 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947621 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947624 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947627 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947629 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947632 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947634 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947638 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947641 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947644 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947647 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947649 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947651 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947654 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947656 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947660 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947664 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:28.954495 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947667 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947671 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947674 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947677 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947679 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947682 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947684 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947687 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947689 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947693 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947695 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947698 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947700 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947703 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947705 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947708 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947711 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947713 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947716 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947719 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:28.955255 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947721 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947724 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947726 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947728 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947731 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947733 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947736 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.947738 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:28.956027 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.948413 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:32:28.958423 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.958402 2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 17:32:28.958467 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.958424 2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958477 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958482 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958485 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958488 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958492 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958495 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958498 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:28.958498 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958500 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958503 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958506 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958509 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958512 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958515 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958517 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958520 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958522 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958525 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958528 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958531 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958533 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958537 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958541 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958544 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958547 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958550 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958552 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958555 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:28.958706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958558 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958561 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958563 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958566 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958569 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958572 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958574 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958577 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958579 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958582 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958585 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958588 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958590 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958593 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958596 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958599 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958601 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958604 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958607 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:28.959195 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958610 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958612 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958615 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958617 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958620 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958623 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958625 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958628 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958630 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958633 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958636 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958638 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958640 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958643 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958646 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958648 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958651 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958653 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958656 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958659 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:28.959698 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958663 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958666 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958668 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958671 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958673 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958676 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958679 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958682 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958685 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958688 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958690 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958693 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958696 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958698 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958701 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958703 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958706 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958709 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958712 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:28.960239 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958714 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.958720 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958839 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958845 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958848 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958851 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958854 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958857 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958859 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958863 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958865 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958868 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958871 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958875 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958879 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 17:32:28.960715 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958882 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958885 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958887 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958890 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958893 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958896 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958898 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958901 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958904 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958908 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958910 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958914 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958917 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958920 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958922 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958925 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958928 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958930 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958933 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 17:32:28.961133 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958936 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958938 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958941 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958943 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958946 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958948 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958951 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958953 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958955 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958958 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958960 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958963 2551 feature_gate.go:328] unrecognized feature gate: Example May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958965 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958968 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958970 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958973 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958975 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958978 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958980 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958983 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958986 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 17:32:28.961610 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958988 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958991 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958994 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958996 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.958998 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959001 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959003 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959006 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959008 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959011 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959014 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959016 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959019 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959021 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959024 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959027 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959029 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959032 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959034 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959037 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 17:32:28.962138 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959040 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959042 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959045 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959047 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959050 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959052 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959054 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959057 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959060 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959062 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959065 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959068 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:28.959070 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.959075 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 17:32:28.962646 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.960140 2551 server.go:962] "Client rotation is on, will bootstrap in background" May 21 17:32:28.963043 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.962535 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 17:32:28.963673 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.963661 2551 server.go:1019] "Starting client certificate rotation" May 21 17:32:28.963783 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.963765 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 17:32:28.963847 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.963813 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 17:32:28.994485 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.994455 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 17:32:28.996369 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:28.996353 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 17:32:29.011832 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.011761 2551 log.go:25] "Validated CRI v1 runtime API" May 21 17:32:29.019398 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.019366 2551 log.go:25] "Validated CRI v1 image API" May 21 17:32:29.021040 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.021023 2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 17:32:29.023549 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.023528 2551 fs.go:135] Filesystem UUIDs: map[542a62ab-81df-4e92-a9b1-e78aa13e3679:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 aba449f2-1376-47fd-b797-c28d0c13bdc0:/dev/nvme0n1p3] May 21 17:32:29.023621 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.023549 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 17:32:29.027918 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.027894 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 17:32:29.028105 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.028004 2551 manager.go:217] Machine: {Timestamp:2026-05-21 17:32:29.027468791 +0000 UTC m=+0.460372483 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3051158 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec237bc17d5d82ea2965bd378414edcb SystemUUID:ec237bc1-7d5d-82ea-2965-bd378414edcb BootID:542b8b5a-2663-4f25-96e3-360cec71d141 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:9b:70:e7:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:9b:70:e7:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:10:8e:f7:cf:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 17:32:29.028832 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.028807 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 17:32:29.028968 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.028954 2551 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 17:32:29.033178 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.033151 2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 17:32:29.033320 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.033181 2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 17:32:29.033364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.033330 2551 topology_manager.go:138] "Creating topology manager with none policy" May 21 17:32:29.033364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.033338 2551 container_manager_linux.go:306] "Creating device plugin manager" May 21 17:32:29.033364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.033346 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 17:32:29.034864 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.034853 2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 17:32:29.037351 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.037339 2551 state_mem.go:36] "Initialized new in-memory state store" May 21 17:32:29.037639 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.037629 2551 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 17:32:29.041204 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.041193 2551 kubelet.go:491] "Attempting to sync node with API server" May 21 17:32:29.041243 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.041214 2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 17:32:29.041243 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.041227 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 17:32:29.041243 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.041237 2551 kubelet.go:397] "Adding apiserver pod source" May 21 17:32:29.041371 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.041247 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 17:32:29.042532 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.042516 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 17:32:29.042532 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.042534 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 17:32:29.045969 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.045950 2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 17:32:29.048144 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.048130 2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 17:32:29.049126 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049112 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 17:32:29.049126 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049128 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049134 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049140 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049150 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049156 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049161 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049167 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049174 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049180 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 17:32:29.049249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049189 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 17:32:29.049571 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.049561 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 17:32:29.050672 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.050663 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 17:32:29.050672 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.050672 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 17:32:29.053921 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.053908 2551 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 17:32:29.054002 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.053946 2551 server.go:1295] "Started kubelet" May 21 17:32:29.054055 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.053994 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 17:32:29.054100 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.054046 2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 17:32:29.054145 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.054132 2551 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 17:32:29.054683 ip-10-0-130-70 systemd[1]: Started Kubernetes Kubelet. May 21 17:32:29.056716 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.056582 2551 server.go:317] "Adding debug handlers to kubelet server" May 21 17:32:29.057175 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.057154 2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 17:32:29.057251 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.057204 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 17:32:29.057305 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.057225 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 17:32:29.057371 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.057358 2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 17:32:29.065628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.065603 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmdrw" May 21 17:32:29.066996 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.066968 2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 17:32:29.068733 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.067650 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-70.ec2.internal.18b1a5006e1b42b8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-70.ec2.internal,UID:ip-10-0-130-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-70.ec2.internal,},FirstTimestamp:2026-05-21 17:32:29.053919928 +0000 UTC m=+0.486823618,LastTimestamp:2026-05-21 17:32:29.053919928 +0000 UTC m=+0.486823618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-70.ec2.internal,}" May 21 17:32:29.068850 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.068794 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 17:32:29.069515 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.069500 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 17:32:29.069675 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.069658 2551 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 17:32:29.069801 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.069780 2551 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 17:32:29.069939 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.069926 2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 17:32:29.070013 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.069997 2551 reconstruct.go:97] "Volume reconstruction finished" May 21 17:32:29.070068 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070014 2551 reconciler.go:26] "Reconciler: start to sync state" May 21 17:32:29.070068 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070058 2551 factory.go:55] Registering systemd factory May 21 17:32:29.070159 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070070 2551 factory.go:223] Registration of the systemd container factory successfully May 21 17:32:29.070321 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070303 2551 factory.go:153] Registering CRI-O factory May 21 17:32:29.070321 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070323 2551 factory.go:223] Registration of the crio container factory successfully May 21 17:32:29.070439 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070425 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 17:32:29.070504 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070448 2551 factory.go:103] Registering Raw factory May 21 17:32:29.070504 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070467 2551 manager.go:1196] Started watching for new ooms in manager May 21 17:32:29.070623 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.070601 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.070899 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.070884 2551 manager.go:319] Starting recovery of all containers May 21 17:32:29.072601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.072572 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmdrw" May 21 17:32:29.073519 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.073485 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 17:32:29.073655 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.073632 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 17:32:29.080352 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.080336 2551 manager.go:324] Recovery completed May 21 17:32:29.084434 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.084420 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:29.087976 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.087961 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:29.088053 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.087988 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:29.088053 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.087999 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:29.088490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.088471 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 17:32:29.088490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.088484 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 17:32:29.088575 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.088499 2551 state_mem.go:36] "Initialized new in-memory state store" May 21 17:32:29.091182 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.091168 2551 policy_none.go:49] "None policy: Start" May 21 17:32:29.091229 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.091185 2551 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 17:32:29.091229 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.091198 2551 state_mem.go:35] "Initializing new in-memory state store" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130149 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130381 2551 manager.go:341] "Starting Device Plugin manager" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.130479 2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130494 2551 server.go:85] "Starting device plugin registration server" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130732 2551 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130744 2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130900 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130965 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.130973 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.131465 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.131489 2551 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.131509 2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.131519 2551 kubelet.go:2451] "Starting kubelet main sync loop" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.131562 2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.132802 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 17:32:29.134471 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.132893 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.135305 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.135029 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:29.231303 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.231210 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:29.231645 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.231623 2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal"] May 21 17:32:29.231730 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.231720 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:29.232368 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.232354 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:29.232450 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.232379 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:29.232450 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.232390 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:29.232450 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.232410 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-70.ec2.internal" May 21 17:32:29.233320 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.233308 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:29.233392 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.233329 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:29.233392 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.233340 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:29.234544 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.234532 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:29.234682 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.234668 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.234718 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.234698 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:29.235228 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.235209 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:29.235318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.235217 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:29.235318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.235264 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:29.235318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.235276 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:29.235318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.235240 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:29.235318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.235314 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:29.236489 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.236474 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" May 21 17:32:29.236541 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.236506 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 17:32:29.237116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.237102 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientMemory" May 21 17:32:29.237185 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.237128 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasNoDiskPressure" May 21 17:32:29.237185 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.237139 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeHasSufficientPID" May 21 17:32:29.242951 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.242931 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-70.ec2.internal" May 21 17:32:29.243007 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.242951 2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-70.ec2.internal\": node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.253339 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.253319 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.257549 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.257529 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-70.ec2.internal\" not found" node="ip-10-0-130-70.ec2.internal" May 21 17:32:29.261848 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.261831 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-70.ec2.internal\" not found" node="ip-10-0-130-70.ec2.internal" May 21 17:32:29.271779 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.271755 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4890f9001ef6dbb250fcc480c4f5e4e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal\" (UID: \"4890f9001ef6dbb250fcc480c4f5e4e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.271881 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.271783 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4890f9001ef6dbb250fcc480c4f5e4e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal\" (UID: \"4890f9001ef6dbb250fcc480c4f5e4e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.271881 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.271803 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e16bd74d5720cb60104d3ed68cf7a63c-config\") pod \"kube-apiserver-proxy-ip-10-0-130-70.ec2.internal\" (UID: \"e16bd74d5720cb60104d3ed68cf7a63c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" May 21 17:32:29.353782 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.353754 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.372183 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.372159 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4890f9001ef6dbb250fcc480c4f5e4e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal\" (UID: \"4890f9001ef6dbb250fcc480c4f5e4e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.372296 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.372102 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4890f9001ef6dbb250fcc480c4f5e4e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal\" (UID: \"4890f9001ef6dbb250fcc480c4f5e4e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.372296 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.372214 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4890f9001ef6dbb250fcc480c4f5e4e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal\" (UID: \"4890f9001ef6dbb250fcc480c4f5e4e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.372296 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.372231 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e16bd74d5720cb60104d3ed68cf7a63c-config\") pod \"kube-apiserver-proxy-ip-10-0-130-70.ec2.internal\" (UID: \"e16bd74d5720cb60104d3ed68cf7a63c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" May 21 17:32:29.372296 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.372259 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e16bd74d5720cb60104d3ed68cf7a63c-config\") pod \"kube-apiserver-proxy-ip-10-0-130-70.ec2.internal\" (UID: \"e16bd74d5720cb60104d3ed68cf7a63c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" May 21 17:32:29.372419 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.372313 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4890f9001ef6dbb250fcc480c4f5e4e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal\" (UID: \"4890f9001ef6dbb250fcc480c4f5e4e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.454298 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.454249 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.555077 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.555000 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.561172 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.561150 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:29.564943 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.564922 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" May 21 17:32:29.655347 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.655319 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.755915 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.755877 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.856432 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.856358 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.956887 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:29.956856 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:29.964027 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.964008 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 17:32:29.964167 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:29.964152 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 17:32:30.057887 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:30.057842 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:30.069242 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.069220 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 17:32:30.074312 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.074285 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 17:27:29 +0000 UTC" deadline="2027-11-20 23:36:24.200943105 +0000 UTC" May 21 17:32:30.074371 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.074311 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13158h3m54.126634832s" May 21 17:32:30.078003 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.077983 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 17:32:30.105582 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.105553 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ph744" May 21 17:32:30.116640 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.116578 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ph744" May 21 17:32:30.158953 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:30.158932 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-70.ec2.internal\" not found" May 21 17:32:30.162215 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.162195 2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:30.170087 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.170057 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" May 21 17:32:30.181547 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.181526 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 17:32:30.183957 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.183840 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" May 21 17:32:30.191401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.191379 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 17:32:30.255295 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:30.255261 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16bd74d5720cb60104d3ed68cf7a63c.slice/crio-9162482b711f9999cb7d452342e9e478bfecf83b814685d20fce97491034465a WatchSource:0}: Error finding container 9162482b711f9999cb7d452342e9e478bfecf83b814685d20fce97491034465a: Status 404 returned error can't find the container with id 9162482b711f9999cb7d452342e9e478bfecf83b814685d20fce97491034465a May 21 17:32:30.255490 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:30.255470 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4890f9001ef6dbb250fcc480c4f5e4e1.slice/crio-c837610c66de36550cd80b8eb1b7df56707f2bb3b10db43022d5244a9d30dc83 WatchSource:0}: Error finding container c837610c66de36550cd80b8eb1b7df56707f2bb3b10db43022d5244a9d30dc83: Status 404 returned error can't find the container with id c837610c66de36550cd80b8eb1b7df56707f2bb3b10db43022d5244a9d30dc83 May 21 17:32:30.260123 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.260108 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:32:30.518583 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.518548 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:30.623528 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.623504 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:30.995977 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:30.995948 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 17:32:31.041834 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.041792 2551 apiserver.go:52] "Watching apiserver" May 21 17:32:31.053343 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.053318 2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 17:32:31.054713 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.054685 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-vqtmq","openshift-image-registry/node-ca-lj7vp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal","openshift-multus/multus-additional-cni-plugins-2l49m","openshift-multus/multus-sqm5p","openshift-multus/network-metrics-daemon-ww4l5","openshift-network-diagnostics/network-check-target-rzr9r","kube-system/konnectivity-agent-sfnqb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7","openshift-network-operator/iptables-alerter-dhxf5","openshift-ovn-kubernetes/ovnkube-node-lbkh6","kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal"] May 21 17:32:31.057402 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.057359 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.057487 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.057450 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.058702 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.058684 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.060033 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.059974 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqm5p" May 21 17:32:31.061224 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.061197 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.061307 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.061261 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:31.062315 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.062295 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:31.062399 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.062358 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:31.062972 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.062945 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 17:32:31.063061 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.062956 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 17:32:31.063061 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.062958 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 17:32:31.063479 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.063464 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.064853 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.064702 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.064938 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.064813 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 17:32:31.064938 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.064891 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 17:32:31.065039 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.064973 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhg8x\"" May 21 17:32:31.065140 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065048 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 17:32:31.065140 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065049 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 17:32:31.065229 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065216 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 17:32:31.065229 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065223 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 17:32:31.065329 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065262 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bbcz\"" May 21 17:32:31.065329 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065262 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltkqm\"" May 21 17:32:31.065432 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065336 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 17:32:31.065432 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.065371 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tjtbf\"" May 21 17:32:31.066171 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.066049 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7p5mb\"" May 21 17:32:31.066171 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.066069 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 17:32:31.066321 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.066281 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 17:32:31.068293 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.068276 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.069529 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.069511 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.070885 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.070852 2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 17:32:31.080702 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-kubelet\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.080812 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080732 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62de6571-701b-4a0c-b546-1fe6324912e0-agent-certs\") pod \"konnectivity-agent-sfnqb\" (UID: \"62de6571-701b-4a0c-b546-1fe6324912e0\") " pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.080894 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080807 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-slash\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.080894 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080849 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-systemd\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.080998 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080916 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-tmp\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.080998 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080945 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cnibin\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.080998 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.080975 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxslg\" (UniqueName: \"kubernetes.io/projected/7a5e40f2-455c-4af0-8502-308ebf85320e-kube-api-access-sxslg\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081147 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081002 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-system-cni-dir\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.081147 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081030 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.081147 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081056 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysconfig\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.081147 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081078 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-var-lib-kubelet\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.081147 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081126 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd4wt\" (UniqueName: \"kubernetes.io/projected/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-kube-api-access-bd4wt\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.081379 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081162 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80c57e38-682f-414c-898e-a523f6587e1c-host\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.081379 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081195 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:31.081486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081402 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.081486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081446 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-etc-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081479 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-ovnkube-script-lib\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081501 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.081623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081515 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-cni-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.081623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081530 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-etc-kubernetes\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.081623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-var-lib-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081581 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081615 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-node-log\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081640 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysctl-d\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081665 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081691 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-cni-binary-copy\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081713 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-multus-certs\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081761 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-systemd\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081782 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-os-release\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081804 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-cni-bin\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.081935 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081841 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf220149-a654-4519-8f0c-adb284d0fbbc-host-slash\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081933 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62de6571-701b-4a0c-b546-1fe6324912e0-konnectivity-ca\") pod \"konnectivity-agent-sfnqb\" (UID: \"62de6571-701b-4a0c-b546-1fe6324912e0\") " pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.081982 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082023 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082052 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80c57e38-682f-414c-898e-a523f6587e1c-serviceca\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082074 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26rlm\" (UniqueName: \"kubernetes.io/projected/52dede10-d44d-4fda-9cc3-9e0f726a3117-kube-api-access-26rlm\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082098 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cf220149-a654-4519-8f0c-adb284d0fbbc-iptables-alerter-script\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082120 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-device-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082153 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-kubelet\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082189 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082244 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lphz\" (UniqueName: \"kubernetes.io/projected/80c57e38-682f-414c-898e-a523f6587e1c-kube-api-access-8lphz\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082269 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysctl-conf\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfsgv\" (UniqueName: \"kubernetes.io/projected/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-kube-api-access-rfsgv\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.082309 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082306 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-systemd-units\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082327 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-run-netns\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082351 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-sys\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082390 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-system-cni-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082411 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-socket-dir-parent\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082432 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-k8s-cni-cncf-io\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082463 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082504 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdwkf\" (UniqueName: \"kubernetes.io/projected/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-kube-api-access-wdwkf\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082540 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-cnibin\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082593 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-cni-multus\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082644 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-conf-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082683 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lztm\" (UniqueName: \"kubernetes.io/projected/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-kube-api-access-7lztm\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-ovnkube-config\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082737 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a5e40f2-455c-4af0-8502-308ebf85320e-ovn-node-metrics-cert\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082761 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-kubernetes\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082787 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-lib-modules\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082809 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-tuned\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.082855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082852 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-hostroot\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082876 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082899 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082923 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-cni-bin\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082966 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-cni-netd\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.082999 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-modprobe-d\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083023 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-os-release\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083047 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btmh\" (UniqueName: \"kubernetes.io/projected/cf220149-a654-4519-8f0c-adb284d0fbbc-kube-api-access-6btmh\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083070 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-ovn\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083095 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083122 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-netns\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083148 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-daemon-config\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083171 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-env-overrides\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083194 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-log-socket\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083216 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-run\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.083490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083238 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-host\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.084106 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.083880 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 17:32:31.084179 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084143 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 17:32:31.084179 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084155 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 17:32:31.084323 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084298 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 17:32:31.084457 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084437 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6vhxn\"" May 21 17:32:31.084554 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084485 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 17:32:31.084554 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084492 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 17:32:31.084789 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.084768 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 17:32:31.085343 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085322 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 17:32:31.085436 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085402 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gzd5v\"" May 21 17:32:31.085436 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085411 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t9dz4\"" May 21 17:32:31.085560 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085439 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 17:32:31.085560 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085331 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 17:32:31.085692 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085561 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 17:32:31.085775 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085759 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 17:32:31.085862 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.085764 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 17:32:31.119372 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.119295 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:27:30 +0000 UTC" deadline="2027-10-20 09:24:42.991069366 +0000 UTC" May 21 17:32:31.119506 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.119493 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12399h52m11.87158268s" May 21 17:32:31.139255 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.139209 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" event={"ID":"4890f9001ef6dbb250fcc480c4f5e4e1","Type":"ContainerStarted","Data":"c837610c66de36550cd80b8eb1b7df56707f2bb3b10db43022d5244a9d30dc83"} May 21 17:32:31.140244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.140221 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" event={"ID":"e16bd74d5720cb60104d3ed68cf7a63c","Type":"ContainerStarted","Data":"9162482b711f9999cb7d452342e9e478bfecf83b814685d20fce97491034465a"} May 21 17:32:31.183997 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.183964 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-env-overrides\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184006 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-log-socket\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184029 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-run\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184048 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-host\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184130 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-host\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184165 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-kubelet\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184184 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-log-socket\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184195 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62de6571-701b-4a0c-b546-1fe6324912e0-agent-certs\") pod \"konnectivity-agent-sfnqb\" (UID: \"62de6571-701b-4a0c-b546-1fe6324912e0\") " pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184221 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-slash\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184227 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-run\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184245 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-systemd\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184272 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-tmp\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184308 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cnibin\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.184362 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184336 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxslg\" (UniqueName: \"kubernetes.io/projected/7a5e40f2-455c-4af0-8502-308ebf85320e-kube-api-access-sxslg\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184366 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-system-cni-dir\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184391 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184432 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysconfig\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184465 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-var-lib-kubelet\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184491 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd4wt\" (UniqueName: \"kubernetes.io/projected/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-kube-api-access-bd4wt\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184517 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80c57e38-682f-414c-898e-a523f6587e1c-host\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184543 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184570 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184577 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184596 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-etc-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184605 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-kubelet\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184623 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-ovnkube-script-lib\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184569 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-env-overrides\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184667 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184674 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-var-lib-kubelet\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184698 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-cni-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184719 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysconfig\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.184774 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184759 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-sys-fs\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184726 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-etc-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184776 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cnibin\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.184878 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.184972 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:31.684941468 +0000 UTC m=+3.117845150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184767 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-etc-kubernetes\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.184726 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-etc-kubernetes\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185021 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-system-cni-dir\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185050 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-var-lib-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185074 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-systemd\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185083 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185108 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-slash\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185109 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-node-log\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185147 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-var-lib-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185155 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-node-log\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185185 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-openvswitch\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185202 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysctl-d\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.185628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185205 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80c57e38-682f-414c-898e-a523f6587e1c-host\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185237 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185263 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-cni-binary-copy\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185268 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-cni-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185291 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-multus-certs\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185286 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-ovnkube-script-lib\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185345 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-systemd\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185364 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-multus-certs\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185375 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-os-release\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185402 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-cni-bin\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185414 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185443 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf220149-a654-4519-8f0c-adb284d0fbbc-host-slash\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185484 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysctl-d\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185492 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62de6571-701b-4a0c-b546-1fe6324912e0-konnectivity-ca\") pod \"konnectivity-agent-sfnqb\" (UID: \"62de6571-701b-4a0c-b546-1fe6324912e0\") " pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185533 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185563 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.186469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185588 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80c57e38-682f-414c-898e-a523f6587e1c-serviceca\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185615 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26rlm\" (UniqueName: \"kubernetes.io/projected/52dede10-d44d-4fda-9cc3-9e0f726a3117-kube-api-access-26rlm\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185619 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185669 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cf220149-a654-4519-8f0c-adb284d0fbbc-iptables-alerter-script\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185697 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-device-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185722 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-kubelet\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185741 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185748 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185778 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lphz\" (UniqueName: \"kubernetes.io/projected/80c57e38-682f-414c-898e-a523f6587e1c-kube-api-access-8lphz\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185808 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-registration-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185803 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysctl-conf\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185865 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfsgv\" (UniqueName: \"kubernetes.io/projected/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-kube-api-access-rfsgv\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185893 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-systemd-units\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185920 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-run-netns\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185944 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-sys\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185962 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186000 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-cni-binary-copy\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.187222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186023 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-device-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186038 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-system-cni-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186057 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-kubelet\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186067 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62de6571-701b-4a0c-b546-1fe6324912e0-konnectivity-ca\") pod \"konnectivity-agent-sfnqb\" (UID: \"62de6571-701b-4a0c-b546-1fe6324912e0\") " pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186134 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-systemd\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186131 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186206 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-cni-bin\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186241 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80c57e38-682f-414c-898e-a523f6587e1c-serviceca\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186248 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf220149-a654-4519-8f0c-adb284d0fbbc-host-slash\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186291 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-systemd-units\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186409 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-sysctl-conf\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.185968 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-system-cni-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186420 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-run-netns\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186457 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-socket-dir-parent\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186484 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-k8s-cni-cncf-io\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186489 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-sys\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186500 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-os-release\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186526 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.188001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186535 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-socket-dir-parent\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186537 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-k8s-cni-cncf-io\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186530 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cf220149-a654-4519-8f0c-adb284d0fbbc-iptables-alerter-script\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186560 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdwkf\" (UniqueName: \"kubernetes.io/projected/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-kube-api-access-wdwkf\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186603 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-cnibin\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186626 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-cni-multus\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186657 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186668 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-cnibin\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186669 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-var-lib-cni-multus\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186729 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-conf-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186761 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lztm\" (UniqueName: \"kubernetes.io/projected/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-kube-api-access-7lztm\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186787 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-ovnkube-config\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186812 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a5e40f2-455c-4af0-8502-308ebf85320e-ovn-node-metrics-cert\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186852 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-kubernetes\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186881 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-lib-modules\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186905 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-tuned\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186929 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-hostroot\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.188809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186954 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.186979 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187004 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-cni-bin\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187028 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-cni-netd\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187052 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-modprobe-d\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187076 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-os-release\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187057 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-conf-dir\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187119 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6btmh\" (UniqueName: \"kubernetes.io/projected/cf220149-a654-4519-8f0c-adb284d0fbbc-kube-api-access-6btmh\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187146 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-os-release\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187259 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a5e40f2-455c-4af0-8502-308ebf85320e-ovnkube-config\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187301 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-socket-dir\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187371 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-lib-modules\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187420 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-kubernetes\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187444 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-ovn\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187462 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-hostroot\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187504 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-cni-netd\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187512 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187148 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-run-ovn\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.189615 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187546 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a5e40f2-455c-4af0-8502-308ebf85320e-host-cni-bin\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187562 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187621 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-netns\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187632 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-modprobe-d\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187647 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-daemon-config\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.187667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-host-run-netns\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.188115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.188132 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-multus-daemon-config\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.189047 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-tmp\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.190486 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.189356 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62de6571-701b-4a0c-b546-1fe6324912e0-agent-certs\") pod \"konnectivity-agent-sfnqb\" (UID: \"62de6571-701b-4a0c-b546-1fe6324912e0\") " pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.191536 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.191514 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-etc-tuned\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.192999 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.192977 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a5e40f2-455c-4af0-8502-308ebf85320e-ovn-node-metrics-cert\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.194879 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.194860 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:31.194971 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.194888 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:31.194971 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.194901 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:31.194971 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.194959 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:31.694941431 +0000 UTC m=+3.127845110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:31.197740 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.197651 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lphz\" (UniqueName: \"kubernetes.io/projected/80c57e38-682f-414c-898e-a523f6587e1c-kube-api-access-8lphz\") pod \"node-ca-lj7vp\" (UID: \"80c57e38-682f-414c-898e-a523f6587e1c\") " pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.199921 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.199789 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdwkf\" (UniqueName: \"kubernetes.io/projected/a5cb6771-fcb6-41db-8fc7-98a4a975a6fb-kube-api-access-wdwkf\") pod \"multus-additional-cni-plugins-2l49m\" (UID: \"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb\") " pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.200783 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.200251 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lztm\" (UniqueName: \"kubernetes.io/projected/cb0c044b-e5a5-4022-892e-ab8c5df1fc89-kube-api-access-7lztm\") pod \"multus-sqm5p\" (UID: \"cb0c044b-e5a5-4022-892e-ab8c5df1fc89\") " pod="openshift-multus/multus-sqm5p" May 21 17:32:31.200783 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.200284 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btmh\" (UniqueName: \"kubernetes.io/projected/cf220149-a654-4519-8f0c-adb284d0fbbc-kube-api-access-6btmh\") pod \"iptables-alerter-dhxf5\" (UID: \"cf220149-a654-4519-8f0c-adb284d0fbbc\") " pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.200783 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.200648 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxslg\" (UniqueName: \"kubernetes.io/projected/7a5e40f2-455c-4af0-8502-308ebf85320e-kube-api-access-sxslg\") pod \"ovnkube-node-lbkh6\" (UID: \"7a5e40f2-455c-4af0-8502-308ebf85320e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.200783 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.200745 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd4wt\" (UniqueName: \"kubernetes.io/projected/fdd25bdf-0e42-4f38-bd64-68d44827dc8d-kube-api-access-bd4wt\") pod \"tuned-vqtmq\" (UID: \"fdd25bdf-0e42-4f38-bd64-68d44827dc8d\") " pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.202075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.202047 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfsgv\" (UniqueName: \"kubernetes.io/projected/5166005e-a1b3-466c-a2a7-442b3d3ad0c3-kube-api-access-rfsgv\") pod \"aws-ebs-csi-driver-node-kllc7\" (UID: \"5166005e-a1b3-466c-a2a7-442b3d3ad0c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.202851 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.202812 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26rlm\" (UniqueName: \"kubernetes.io/projected/52dede10-d44d-4fda-9cc3-9e0f726a3117-kube-api-access-26rlm\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.369548 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.369463 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" May 21 17:32:31.375860 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.375830 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lj7vp" May 21 17:32:31.386619 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.386591 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:31.393506 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.393480 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2l49m" May 21 17:32:31.401222 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.401201 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqm5p" May 21 17:32:31.407844 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.407813 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:31.415398 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.415369 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" May 21 17:32:31.420893 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.420876 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhxf5" May 21 17:32:31.691809 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.691779 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:31.691984 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.691942 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:31.692065 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.692010 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:32.691995206 +0000 UTC m=+4.124898884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:31.792961 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:31.792929 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:31.793125 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.793076 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:31.793125 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.793094 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:31.793125 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.793106 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:31.793256 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:31.793159 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:32.793146121 +0000 UTC m=+4.226049799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:32.070480 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.070453 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5e40f2_455c_4af0_8502_308ebf85320e.slice/crio-dfe34ece32c8125a6c23ceca991df57758f3a886c1c9e2105421b63dcf85ba4d WatchSource:0}: Error finding container dfe34ece32c8125a6c23ceca991df57758f3a886c1c9e2105421b63dcf85ba4d: Status 404 returned error can't find the container with id dfe34ece32c8125a6c23ceca991df57758f3a886c1c9e2105421b63dcf85ba4d May 21 17:32:32.071431 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.071409 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd25bdf_0e42_4f38_bd64_68d44827dc8d.slice/crio-b77f4feedce9b88f9a6601c39d201266f7d0d9ef6cee6c3f86ec3be2512372d6 WatchSource:0}: Error finding container b77f4feedce9b88f9a6601c39d201266f7d0d9ef6cee6c3f86ec3be2512372d6: Status 404 returned error can't find the container with id b77f4feedce9b88f9a6601c39d201266f7d0d9ef6cee6c3f86ec3be2512372d6 May 21 17:32:32.072911 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.072879 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf220149_a654_4519_8f0c_adb284d0fbbc.slice/crio-f04fe8621202d0736d0215646d5ac987d5af0ca7d33f1d7f9d63cee3c450db8b WatchSource:0}: Error finding container f04fe8621202d0736d0215646d5ac987d5af0ca7d33f1d7f9d63cee3c450db8b: Status 404 returned error can't find the container with id f04fe8621202d0736d0215646d5ac987d5af0ca7d33f1d7f9d63cee3c450db8b May 21 17:32:32.074541 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.074520 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cb6771_fcb6_41db_8fc7_98a4a975a6fb.slice/crio-433dd6599ab07398c092ee30bc4fad0bb4324efe980933dda9c5df1860bd1cfb WatchSource:0}: Error finding container 433dd6599ab07398c092ee30bc4fad0bb4324efe980933dda9c5df1860bd1cfb: Status 404 returned error can't find the container with id 433dd6599ab07398c092ee30bc4fad0bb4324efe980933dda9c5df1860bd1cfb May 21 17:32:32.076503 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.076480 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c57e38_682f_414c_898e_a523f6587e1c.slice/crio-249c00effeb4ffc4d34e15cd5a14ef53ebaee47d0a3a8fa8ddbdc3bad00a1151 WatchSource:0}: Error finding container 249c00effeb4ffc4d34e15cd5a14ef53ebaee47d0a3a8fa8ddbdc3bad00a1151: Status 404 returned error can't find the container with id 249c00effeb4ffc4d34e15cd5a14ef53ebaee47d0a3a8fa8ddbdc3bad00a1151 May 21 17:32:32.077544 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.077520 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62de6571_701b_4a0c_b546_1fe6324912e0.slice/crio-6a2feeb21e890662be0c6fb6e3cbe5da9a2dea66d957714f282f658d2e598972 WatchSource:0}: Error finding container 6a2feeb21e890662be0c6fb6e3cbe5da9a2dea66d957714f282f658d2e598972: Status 404 returned error can't find the container with id 6a2feeb21e890662be0c6fb6e3cbe5da9a2dea66d957714f282f658d2e598972 May 21 17:32:32.078998 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.078873 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0c044b_e5a5_4022_892e_ab8c5df1fc89.slice/crio-49cd4844cb5ffb78ab7059c1ed07f69d8b89eac6dc65c3aaea930432b40101ed WatchSource:0}: Error finding container 49cd4844cb5ffb78ab7059c1ed07f69d8b89eac6dc65c3aaea930432b40101ed: Status 404 returned error can't find the container with id 49cd4844cb5ffb78ab7059c1ed07f69d8b89eac6dc65c3aaea930432b40101ed May 21 17:32:32.080204 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:32.080156 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5166005e_a1b3_466c_a2a7_442b3d3ad0c3.slice/crio-212f70f08cae979c3dcb3bbf30e47eb841c2ccf335442445a40d3ebac305f748 WatchSource:0}: Error finding container 212f70f08cae979c3dcb3bbf30e47eb841c2ccf335442445a40d3ebac305f748: Status 404 returned error can't find the container with id 212f70f08cae979c3dcb3bbf30e47eb841c2ccf335442445a40d3ebac305f748 May 21 17:32:32.120606 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.120575 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:27:30 +0000 UTC" deadline="2027-10-18 07:35:31.982077441 +0000 UTC" May 21 17:32:32.120606 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.120602 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12350h2m59.861478077s" May 21 17:32:32.131756 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.131727 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:32.131925 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.131900 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:32.142505 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.142441 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" event={"ID":"5166005e-a1b3-466c-a2a7-442b3d3ad0c3","Type":"ContainerStarted","Data":"212f70f08cae979c3dcb3bbf30e47eb841c2ccf335442445a40d3ebac305f748"} May 21 17:32:32.143408 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.143384 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sfnqb" event={"ID":"62de6571-701b-4a0c-b546-1fe6324912e0","Type":"ContainerStarted","Data":"6a2feeb21e890662be0c6fb6e3cbe5da9a2dea66d957714f282f658d2e598972"} May 21 17:32:32.144338 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.144318 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lj7vp" event={"ID":"80c57e38-682f-414c-898e-a523f6587e1c","Type":"ContainerStarted","Data":"249c00effeb4ffc4d34e15cd5a14ef53ebaee47d0a3a8fa8ddbdc3bad00a1151"} May 21 17:32:32.145224 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.145206 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" event={"ID":"fdd25bdf-0e42-4f38-bd64-68d44827dc8d","Type":"ContainerStarted","Data":"b77f4feedce9b88f9a6601c39d201266f7d0d9ef6cee6c3f86ec3be2512372d6"} May 21 17:32:32.146272 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.146240 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqm5p" event={"ID":"cb0c044b-e5a5-4022-892e-ab8c5df1fc89","Type":"ContainerStarted","Data":"49cd4844cb5ffb78ab7059c1ed07f69d8b89eac6dc65c3aaea930432b40101ed"} May 21 17:32:32.147111 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.147087 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerStarted","Data":"433dd6599ab07398c092ee30bc4fad0bb4324efe980933dda9c5df1860bd1cfb"} May 21 17:32:32.148112 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.148094 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhxf5" event={"ID":"cf220149-a654-4519-8f0c-adb284d0fbbc","Type":"ContainerStarted","Data":"f04fe8621202d0736d0215646d5ac987d5af0ca7d33f1d7f9d63cee3c450db8b"} May 21 17:32:32.149007 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.148986 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"dfe34ece32c8125a6c23ceca991df57758f3a886c1c9e2105421b63dcf85ba4d"} May 21 17:32:32.700530 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.700417 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:32.700692 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.700598 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:32.700692 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.700656 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:34.700638245 +0000 UTC m=+6.133541930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:32.801778 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:32.801230 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:32.801778 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.801371 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:32.801778 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.801389 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:32.801778 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.801402 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:32.801778 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:32.801451 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:34.801434379 +0000 UTC m=+6.234338073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:33.135378 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.134988 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:33.135378 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:33.135116 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:33.158369 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.158333 2551 generic.go:358] "Generic (PLEG): container finished" podID="4890f9001ef6dbb250fcc480c4f5e4e1" containerID="f6ffddb83c268b422ff9d224a37ab9190f176d4368ce768bd1d624541b45af10" exitCode=0 May 21 17:32:33.158542 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.158417 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" event={"ID":"4890f9001ef6dbb250fcc480c4f5e4e1","Type":"ContainerDied","Data":"f6ffddb83c268b422ff9d224a37ab9190f176d4368ce768bd1d624541b45af10"} May 21 17:32:33.171676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.171591 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" event={"ID":"e16bd74d5720cb60104d3ed68cf7a63c","Type":"ContainerStarted","Data":"18c6226fcd1378667e43dc5164c1391750e6727e731b79ca1729ed224a73bf7f"} May 21 17:32:33.569316 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.569251 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-70.ec2.internal" podStartSLOduration=3.5692171520000002 podStartE2EDuration="3.569217152s" podCreationTimestamp="2026-05-21 17:32:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:32:33.185895115 +0000 UTC m=+4.618798817" watchObservedRunningTime="2026-05-21 17:32:33.569217152 +0000 UTC m=+5.002120834" May 21 17:32:33.571940 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.570421 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kftnl"] May 21 17:32:33.574228 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.574204 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.574327 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:33.574285 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:33.607253 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.607212 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.607407 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.607290 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-kubelet-config\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.607407 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.607318 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-dbus\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.708572 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.708475 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-kubelet-config\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.708572 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.708528 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-dbus\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.708794 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.708607 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-kubelet-config\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.708794 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.708675 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-dbus\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.708794 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:33.708687 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:33.708986 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:33.708853 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:33.708986 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:33.708921 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret podName:f8d9b829-b7c1-470b-a0a2-e3464bf3162c nodeName:}" failed. No retries permitted until 2026-05-21 17:32:34.208902631 +0000 UTC m=+5.641806320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret") pod "global-pull-secret-syncer-kftnl" (UID: "f8d9b829-b7c1-470b-a0a2-e3464bf3162c") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:34.132651 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:34.132620 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:34.132852 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.132763 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:34.187413 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:34.187380 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" event={"ID":"4890f9001ef6dbb250fcc480c4f5e4e1","Type":"ContainerStarted","Data":"67d77c82776b9b087b84464435ab2f8ebe76ad71db215ceb9fb057a0135f8fd3"} May 21 17:32:34.199873 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:34.199807 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-70.ec2.internal" podStartSLOduration=4.199790365 podStartE2EDuration="4.199790365s" podCreationTimestamp="2026-05-21 17:32:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:32:34.199620257 +0000 UTC m=+5.632523959" watchObservedRunningTime="2026-05-21 17:32:34.199790365 +0000 UTC m=+5.632694067" May 21 17:32:34.213833 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:34.213783 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:34.214008 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.213963 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:34.214064 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.214027 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret podName:f8d9b829-b7c1-470b-a0a2-e3464bf3162c nodeName:}" failed. No retries permitted until 2026-05-21 17:32:35.214008399 +0000 UTC m=+6.646912083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret") pod "global-pull-secret-syncer-kftnl" (UID: "f8d9b829-b7c1-470b-a0a2-e3464bf3162c") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:34.718547 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:34.718506 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:34.718739 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.718672 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:34.718739 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.718739 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:38.718718736 +0000 UTC m=+10.151622419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:34.819443 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:34.819404 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:34.819655 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.819632 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:34.819726 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.819657 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:34.819726 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.819671 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:34.819858 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:34.819731 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:38.819712961 +0000 UTC m=+10.252616644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:35.132753 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:35.132669 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:35.133008 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:35.132810 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:35.133008 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:35.132846 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:35.133008 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:35.132959 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:35.223489 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:35.223441 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:35.223963 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:35.223624 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:35.223963 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:35.223710 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret podName:f8d9b829-b7c1-470b-a0a2-e3464bf3162c nodeName:}" failed. No retries permitted until 2026-05-21 17:32:37.223689954 +0000 UTC m=+8.656593637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret") pod "global-pull-secret-syncer-kftnl" (UID: "f8d9b829-b7c1-470b-a0a2-e3464bf3162c") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:36.131859 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:36.131808 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:36.132069 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:36.131972 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:37.132143 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:37.132105 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:37.132574 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:37.132161 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:37.132574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:37.132242 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:37.132574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:37.132356 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:37.240413 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:37.240338 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:37.240585 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:37.240510 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:37.240644 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:37.240586 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret podName:f8d9b829-b7c1-470b-a0a2-e3464bf3162c nodeName:}" failed. No retries permitted until 2026-05-21 17:32:41.240565341 +0000 UTC m=+12.673469022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret") pod "global-pull-secret-syncer-kftnl" (UID: "f8d9b829-b7c1-470b-a0a2-e3464bf3162c") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:38.133056 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:38.132540 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:38.133056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.132689 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:38.751006 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:38.750959 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:38.751183 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.751119 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:38.751230 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.751194 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:46.751173015 +0000 UTC m=+18.184076702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:38.851989 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:38.851946 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:38.852167 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.852119 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:38.852167 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.852137 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:38.852167 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.852150 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:38.852331 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:38.852219 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:46.85220166 +0000 UTC m=+18.285105342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:39.133494 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:39.133301 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:39.133494 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:39.133304 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:39.133982 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:39.133578 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:39.134719 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:39.134543 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:40.132354 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:40.132319 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:40.132544 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:40.132453 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:40.980432 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:40.980394 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-cgjpr"] May 21 17:32:40.994088 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:40.993953 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:40.996328 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:40.996293 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 17:32:40.996600 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:40.996451 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 17:32:40.997277 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:40.997258 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8lbvd\"" May 21 17:32:41.070111 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.070068 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e30383e-0967-4e33-9837-90aa0c04a17f-hosts-file\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.070283 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.070133 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rmcj\" (UniqueName: \"kubernetes.io/projected/8e30383e-0967-4e33-9837-90aa0c04a17f-kube-api-access-7rmcj\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.070283 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.070251 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e30383e-0967-4e33-9837-90aa0c04a17f-tmp-dir\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.132971 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.132496 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:41.132971 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:41.132615 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:41.132971 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.132842 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:41.132971 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:41.132963 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:41.170799 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.170754 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e30383e-0967-4e33-9837-90aa0c04a17f-hosts-file\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.170799 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.170797 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rmcj\" (UniqueName: \"kubernetes.io/projected/8e30383e-0967-4e33-9837-90aa0c04a17f-kube-api-access-7rmcj\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.171036 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.170876 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e30383e-0967-4e33-9837-90aa0c04a17f-tmp-dir\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.171036 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.170914 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e30383e-0967-4e33-9837-90aa0c04a17f-hosts-file\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.171214 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.171198 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e30383e-0967-4e33-9837-90aa0c04a17f-tmp-dir\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.180721 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.180693 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rmcj\" (UniqueName: \"kubernetes.io/projected/8e30383e-0967-4e33-9837-90aa0c04a17f-kube-api-access-7rmcj\") pod \"node-resolver-cgjpr\" (UID: \"8e30383e-0967-4e33-9837-90aa0c04a17f\") " pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:41.272233 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.272079 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:41.272233 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:41.272227 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:41.272443 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:41.272291 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret podName:f8d9b829-b7c1-470b-a0a2-e3464bf3162c nodeName:}" failed. No retries permitted until 2026-05-21 17:32:49.272274439 +0000 UTC m=+20.705178123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret") pod "global-pull-secret-syncer-kftnl" (UID: "f8d9b829-b7c1-470b-a0a2-e3464bf3162c") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:41.305364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:41.305334 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cgjpr" May 21 17:32:42.132515 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:42.132486 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:42.132945 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:42.132603 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:43.132211 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:43.132169 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:43.132404 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:43.132184 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:43.132404 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:43.132306 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:43.132404 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:43.132369 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:44.132094 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:44.132061 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:44.132482 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:44.132200 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:45.131800 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:45.131742 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:45.131800 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:45.131779 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:45.132064 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:45.131894 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:45.132064 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:45.132033 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:46.132213 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:46.132169 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:46.132613 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.132343 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:46.820131 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:46.820095 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:46.820386 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.820215 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:46.820386 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.820283 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:02.820263985 +0000 UTC m=+34.253167677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:32:46.921208 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:46.921172 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:46.921369 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.921306 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:32:46.921369 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.921330 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:32:46.921369 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.921344 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:46.921525 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:46.921407 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:02.921390927 +0000 UTC m=+34.354294606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:32:47.132124 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:47.132085 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:47.132310 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:47.132093 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:47.132310 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:47.132228 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:47.132310 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:47.132297 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:48.131856 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:48.131809 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:48.132009 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:48.131932 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:49.132896 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:49.132870 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:49.133269 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:49.132950 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:49.133269 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:49.133039 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:49.133269 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:49.133157 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:49.339588 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:49.339553 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:49.339746 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:49.339666 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 17:32:49.339746 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:49.339722 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret podName:f8d9b829-b7c1-470b-a0a2-e3464bf3162c nodeName:}" failed. No retries permitted until 2026-05-21 17:33:05.339707631 +0000 UTC m=+36.772611310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret") pod "global-pull-secret-syncer-kftnl" (UID: "f8d9b829-b7c1-470b-a0a2-e3464bf3162c") : object "kube-system"/"original-pull-secret" not registered May 21 17:32:49.702733 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:32:49.702695 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e30383e_0967_4e33_9837_90aa0c04a17f.slice/crio-61343ad0162b7451c3993d63e6009987acb51321058288406bf14dd83e000f02 WatchSource:0}: Error finding container 61343ad0162b7451c3993d63e6009987acb51321058288406bf14dd83e000f02: Status 404 returned error can't find the container with id 61343ad0162b7451c3993d63e6009987acb51321058288406bf14dd83e000f02 May 21 17:32:50.132200 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.131936 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:50.132376 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:50.132351 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:50.215628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.215548 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lj7vp" event={"ID":"80c57e38-682f-414c-898e-a523f6587e1c","Type":"ContainerStarted","Data":"e7c2dc69bbaefd8b99ab15632d412ac3af1115e5d291fde54fe1884558520d9f"} May 21 17:32:50.217034 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.217004 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" event={"ID":"fdd25bdf-0e42-4f38-bd64-68d44827dc8d","Type":"ContainerStarted","Data":"3821925520bcb6430283ab033e5a48942428d30d687729e224fdc788d6db96ab"} May 21 17:32:50.218270 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.218241 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cgjpr" event={"ID":"8e30383e-0967-4e33-9837-90aa0c04a17f","Type":"ContainerStarted","Data":"750da9c8312c298c9491ea7650322a7502f1737e106f196889f5147cfe1e911e"} May 21 17:32:50.218270 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.218270 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cgjpr" event={"ID":"8e30383e-0967-4e33-9837-90aa0c04a17f","Type":"ContainerStarted","Data":"61343ad0162b7451c3993d63e6009987acb51321058288406bf14dd83e000f02"} May 21 17:32:50.219406 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.219386 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqm5p" event={"ID":"cb0c044b-e5a5-4022-892e-ab8c5df1fc89","Type":"ContainerStarted","Data":"86e5f3e91503c5929d7955e3ccf861085ab32e9770249c267c538947acb702d5"} May 21 17:32:50.220765 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.220738 2551 generic.go:358] "Generic (PLEG): container finished" podID="a5cb6771-fcb6-41db-8fc7-98a4a975a6fb" containerID="e1b9cce8a6cb4dabf8f317ce4197149679a29cb68d10923bb2dd514ff0900d3a" exitCode=0 May 21 17:32:50.220864 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.220809 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerDied","Data":"e1b9cce8a6cb4dabf8f317ce4197149679a29cb68d10923bb2dd514ff0900d3a"} May 21 17:32:50.222464 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.222443 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:32:50.222790 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.222769 2551 generic.go:358] "Generic (PLEG): container finished" podID="7a5e40f2-455c-4af0-8502-308ebf85320e" containerID="92dc2726a428f757e6ab696c7706d4c77f046bfb046fef95da04537fd96a2315" exitCode=1 May 21 17:32:50.222869 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.222841 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"9caeea294f1a50d50340b70694e35d7ff2725bf2584448e3e32c6f58eb99b86b"} May 21 17:32:50.222925 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.222870 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerDied","Data":"92dc2726a428f757e6ab696c7706d4c77f046bfb046fef95da04537fd96a2315"} May 21 17:32:50.222925 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.222886 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"644823d16747f99bf5b1763934019cad185fb7121b22d6f0689742f327f72af1"} May 21 17:32:50.224111 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.224070 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" event={"ID":"5166005e-a1b3-466c-a2a7-442b3d3ad0c3","Type":"ContainerStarted","Data":"fb08e1af182d181466378cc24446078bf39703b4afe30f75352b6b5c4e5b0ddc"} May 21 17:32:50.225269 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.225247 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sfnqb" event={"ID":"62de6571-701b-4a0c-b546-1fe6324912e0","Type":"ContainerStarted","Data":"935ade09ca97d41f7409c520c2b73d04025a42e8fda0f9e4e78b65170f485128"} May 21 17:32:50.227709 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.227671 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lj7vp" podStartSLOduration=8.344769239 podStartE2EDuration="21.227661653s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.078600548 +0000 UTC m=+3.511504234" lastFinishedPulling="2026-05-21 17:32:44.961492966 +0000 UTC m=+16.394396648" observedRunningTime="2026-05-21 17:32:50.227626379 +0000 UTC m=+21.660530080" watchObservedRunningTime="2026-05-21 17:32:50.227661653 +0000 UTC m=+21.660565353" May 21 17:32:50.260894 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.260853 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-sqm5p" podStartSLOduration=3.627730264 podStartE2EDuration="21.260841658s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.08129158 +0000 UTC m=+3.514195262" lastFinishedPulling="2026-05-21 17:32:49.714402973 +0000 UTC m=+21.147306656" observedRunningTime="2026-05-21 17:32:50.260324288 +0000 UTC m=+21.693227989" watchObservedRunningTime="2026-05-21 17:32:50.260841658 +0000 UTC m=+21.693745362" May 21 17:32:50.272627 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.272588 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sfnqb" podStartSLOduration=3.65650634 podStartE2EDuration="21.272574357s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.079490612 +0000 UTC m=+3.512394294" lastFinishedPulling="2026-05-21 17:32:49.69555863 +0000 UTC m=+21.128462311" observedRunningTime="2026-05-21 17:32:50.272065362 +0000 UTC m=+21.704969066" watchObservedRunningTime="2026-05-21 17:32:50.272574357 +0000 UTC m=+21.705478058" May 21 17:32:50.295223 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.295181 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-cgjpr" podStartSLOduration=10.295165031 podStartE2EDuration="10.295165031s" podCreationTimestamp="2026-05-21 17:32:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:32:50.283293383 +0000 UTC m=+21.716197084" watchObservedRunningTime="2026-05-21 17:32:50.295165031 +0000 UTC m=+21.728068731" May 21 17:32:50.295350 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:50.295307 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vqtmq" podStartSLOduration=3.523568341 podStartE2EDuration="21.295298382s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.073692879 +0000 UTC m=+3.506596568" lastFinishedPulling="2026-05-21 17:32:49.84542293 +0000 UTC m=+21.278326609" observedRunningTime="2026-05-21 17:32:50.294853988 +0000 UTC m=+21.727757689" watchObservedRunningTime="2026-05-21 17:32:50.295298382 +0000 UTC m=+21.728202085" May 21 17:32:51.132146 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.132110 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:51.132365 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.132129 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:51.132365 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:51.132251 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:51.132365 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:51.132288 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:51.229758 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.229510 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhxf5" event={"ID":"cf220149-a654-4519-8f0c-adb284d0fbbc","Type":"ContainerStarted","Data":"0ba3dd0db6681f711fbc8b2ad7fb5f41ccd5b027e7ce7f25bfec5065c13f6340"} May 21 17:32:51.232973 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.232950 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:32:51.233506 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.233478 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"45e137bc7ba85a707e07a92a9d0ca7cbcce9548b8683a24b00333c60b65d7a6b"} May 21 17:32:51.233601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.233519 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"d4fa551824a15006d3fd886e4f19c2d03fa7d23f01338033be77d37a2659982d"} May 21 17:32:51.233601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.233533 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"31a962d9f3bf23b7a0aa85b887d37ba8015562769743e276789eff7af1352c9b"} May 21 17:32:51.325075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.325042 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 17:32:51.735600 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.735529 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:51.736075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.736055 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:51.749403 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:51.749362 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dhxf5" podStartSLOduration=5.129146144 podStartE2EDuration="22.74934958s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.075353994 +0000 UTC m=+3.508257675" lastFinishedPulling="2026-05-21 17:32:49.695557431 +0000 UTC m=+21.128461111" observedRunningTime="2026-05-21 17:32:51.251653226 +0000 UTC m=+22.684556927" watchObservedRunningTime="2026-05-21 17:32:51.74934958 +0000 UTC m=+23.182253282" May 21 17:32:52.131971 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.131888 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:52.132152 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:52.132037 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:52.144832 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.144702 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T17:32:51.325064856Z","UUID":"ae368af2-a0ac-40ae-9e67-09c19fdd0c0e","Handler":null,"Name":"","Endpoint":""} May 21 17:32:52.147154 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.146945 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 17:32:52.147154 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.146975 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 17:32:52.237170 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.237120 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" event={"ID":"5166005e-a1b3-466c-a2a7-442b3d3ad0c3","Type":"ContainerStarted","Data":"c07ec7832f375ec79c70055bf5ff3d6055ad4f939be77b9b03ce5603deaff7c0"} May 21 17:32:52.237782 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.237374 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:52.237892 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:52.237875 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sfnqb" May 21 17:32:53.132515 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:53.132482 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:53.132701 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:53.132484 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:53.132701 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:53.132585 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:53.132701 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:53.132661 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:53.240322 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:53.240283 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" event={"ID":"5166005e-a1b3-466c-a2a7-442b3d3ad0c3","Type":"ContainerStarted","Data":"615b11fb379f7419c3d5f81738a15827851c6657d2e11902564562a8c1cd4332"} May 21 17:32:53.243241 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:53.243220 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:32:53.243597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:53.243567 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"df635c185bb80c69f3711fd01ba05b2819093aafeb64f8707a44217754164a33"} May 21 17:32:53.258988 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:53.258911 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kllc7" podStartSLOduration=4.061873714 podStartE2EDuration="24.258893595s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.082548027 +0000 UTC m=+3.515451709" lastFinishedPulling="2026-05-21 17:32:52.279567898 +0000 UTC m=+23.712471590" observedRunningTime="2026-05-21 17:32:53.258370324 +0000 UTC m=+24.691274037" watchObservedRunningTime="2026-05-21 17:32:53.258893595 +0000 UTC m=+24.691797298" May 21 17:32:54.132564 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:54.132527 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:54.132727 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:54.132673 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:55.132034 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.131846 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:55.132433 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.131852 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:55.132433 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:55.132096 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:55.132433 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:55.132166 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:55.250359 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.250279 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:32:55.250677 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.250654 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"1b95500af27b385b3a4bd5df4982e2f8438221869ee5843b2b8735cb7c8c0f57"} May 21 17:32:55.250949 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.250905 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:55.251057 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.250952 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:55.251154 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.251138 2551 scope.go:117] "RemoveContainer" containerID="92dc2726a428f757e6ab696c7706d4c77f046bfb046fef95da04537fd96a2315" May 21 17:32:55.252524 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.252498 2551 generic.go:358] "Generic (PLEG): container finished" podID="a5cb6771-fcb6-41db-8fc7-98a4a975a6fb" containerID="7a5ab2d9a7fb286fde3e63b7c97f1a09791546d32fd41da58228ef2b402f8285" exitCode=0 May 21 17:32:55.252614 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.252539 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerDied","Data":"7a5ab2d9a7fb286fde3e63b7c97f1a09791546d32fd41da58228ef2b402f8285"} May 21 17:32:55.270278 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:55.270253 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:56.132397 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.132375 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:56.132753 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:56.132525 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:56.256152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.256122 2551 generic.go:358] "Generic (PLEG): container finished" podID="a5cb6771-fcb6-41db-8fc7-98a4a975a6fb" containerID="da0ffc45db8b8bc55ad54ea678dc5a61773df16d108ccb5b35d0b85b8b5d96bf" exitCode=0 May 21 17:32:56.256303 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.256203 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerDied","Data":"da0ffc45db8b8bc55ad54ea678dc5a61773df16d108ccb5b35d0b85b8b5d96bf"} May 21 17:32:56.265212 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.265193 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:32:56.265581 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.265543 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" event={"ID":"7a5e40f2-455c-4af0-8502-308ebf85320e","Type":"ContainerStarted","Data":"36a1be1f3b89fd2224eb50425751d9bb1eeacc346fa0ab241cd2d026672db187"} May 21 17:32:56.265791 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.265766 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:56.280728 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.280705 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:32:56.302234 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.302023 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" podStartSLOduration=9.624506407 podStartE2EDuration="27.302009262s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.072084235 +0000 UTC m=+3.504987914" lastFinishedPulling="2026-05-21 17:32:49.749587088 +0000 UTC m=+21.182490769" observedRunningTime="2026-05-21 17:32:56.300527565 +0000 UTC m=+27.733431279" watchObservedRunningTime="2026-05-21 17:32:56.302009262 +0000 UTC m=+27.734912962" May 21 17:32:56.703018 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.702988 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kftnl"] May 21 17:32:56.703167 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.703108 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:56.703216 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:56.703194 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:32:56.709905 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.709877 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rzr9r"] May 21 17:32:56.710071 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.709994 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:56.710135 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:56.710086 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:56.710729 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.710699 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ww4l5"] May 21 17:32:56.710846 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:56.710813 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:56.710958 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:56.710937 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:57.269114 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:57.269077 2551 generic.go:358] "Generic (PLEG): container finished" podID="a5cb6771-fcb6-41db-8fc7-98a4a975a6fb" containerID="5a3e3c0bf5584e76b9d9033849ab5373092ac3c185ae7fa7c0b9fae058a88d25" exitCode=0 May 21 17:32:57.269449 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:57.269167 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerDied","Data":"5a3e3c0bf5584e76b9d9033849ab5373092ac3c185ae7fa7c0b9fae058a88d25"} May 21 17:32:58.132577 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:58.132544 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:32:58.132742 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:58.132550 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:32:58.132742 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:58.132676 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:32:58.132742 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:32:58.132550 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:32:58.132936 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:58.132739 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:32:58.132936 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:32:58.132875 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:33:00.132733 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:00.132693 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:33:00.133417 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:00.132693 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:33:00.133417 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:00.132838 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:33:00.133417 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:00.132693 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:00.133417 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:00.132919 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:33:00.133417 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:00.132985 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:33:02.132291 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.132260 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:33:02.132890 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.132370 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kftnl" podUID="f8d9b829-b7c1-470b-a0a2-e3464bf3162c" May 21 17:33:02.132890 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.132380 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:02.132890 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.132410 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:33:02.132890 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.132454 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzr9r" podUID="b9b95f2b-9aee-4004-b48e-d812dfb5b321" May 21 17:33:02.132890 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.132548 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:33:02.846011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.845935 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:33:02.846171 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.846079 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:33:02.846171 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.846141 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:34.846125062 +0000 UTC m=+66.279028747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 17:33:02.847598 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.847577 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-70.ec2.internal" event="NodeReady" May 21 17:33:02.847733 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.847723 2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 17:33:02.881358 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.881328 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs"] May 21 17:33:02.883462 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.883437 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:02.886161 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.886139 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 17:33:02.887130 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.887084 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x"] May 21 17:33:02.887406 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.887385 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 17:33:02.888910 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.888661 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 17:33:02.888997 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.888910 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 17:33:02.888997 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.888923 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:02.889811 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.889791 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2vf2q\"" May 21 17:33:02.889994 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.889979 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c9f96476-pj9c9"] May 21 17:33:02.891500 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.891482 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 17:33:02.891692 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.891675 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk"] May 21 17:33:02.891840 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.891811 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:02.892779 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.892756 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 17:33:02.892955 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.892939 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9kjgp\"" May 21 17:33:02.893481 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.893459 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw"] May 21 17:33:02.893609 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.893588 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:02.894210 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.894192 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 17:33:02.894359 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.894198 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 17:33:02.894893 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.894877 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rwzsm\"" May 21 17:33:02.895492 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.895209 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 17:33:02.895600 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.895584 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:02.897044 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.897027 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 17:33:02.902656 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.902478 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 17:33:02.902656 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.902659 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 17:33:02.902845 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.902726 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 17:33:02.902845 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.902639 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 17:33:02.903358 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.903339 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs"] May 21 17:33:02.905870 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.905848 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-92v7g"] May 21 17:33:02.907779 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.907762 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rk78k"] May 21 17:33:02.908041 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.908022 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:02.909581 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.909560 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk78k" May 21 17:33:02.911202 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.911186 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 17:33:02.912347 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.912325 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 17:33:02.912440 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.912326 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 17:33:02.912748 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.912732 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rz88\"" May 21 17:33:02.913234 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.913220 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhpf9\"" May 21 17:33:02.913607 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.913587 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 17:33:02.914237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.914221 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 17:33:02.922482 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.922452 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw"] May 21 17:33:02.925154 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.925130 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk"] May 21 17:33:02.927103 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.927083 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 17:33:02.943025 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.942999 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-92v7g"] May 21 17:33:02.943725 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.943706 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x"] May 21 17:33:02.946782 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.946760 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:02.946946 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.946894 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 17:33:02.947018 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.946963 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 17:33:02.947018 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.946978 2551 projected.go:194] Error preparing data for projected volume kube-api-access-97tks for pod openshift-network-diagnostics/network-check-target-rzr9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:33:02.947112 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:02.947040 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks podName:b9b95f2b-9aee-4004-b48e-d812dfb5b321 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:34.94702053 +0000 UTC m=+66.379924210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-97tks" (UniqueName: "kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks") pod "network-check-target-rzr9r" (UID: "b9b95f2b-9aee-4004-b48e-d812dfb5b321") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 17:33:02.956304 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.956269 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rk78k"] May 21 17:33:02.960685 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:02.960660 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c9f96476-pj9c9"] May 21 17:33:03.048143 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048107 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-trusted-ca\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048302 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048152 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspwv\" (UniqueName: \"kubernetes.io/projected/176a8b84-1d81-4b38-8410-df549e2516e5-kube-api-access-qspwv\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.048302 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048176 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.048302 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048214 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-bound-sa-token\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048302 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048253 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/666952a3-1d54-4f34-8af4-be3d6b26c1cb-klusterlet-config\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.048469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048327 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:03.048469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048363 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2d7244a-2d38-4a97-9509-a6f23d1c9204-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6975cd79b-k8whs\" (UID: \"e2d7244a-2d38-4a97-9509-a6f23d1c9204\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.048469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048389 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smccs\" (UniqueName: \"kubernetes.io/projected/d485cd73-3de1-43b8-8191-08b7034e310f-kube-api-access-smccs\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.048469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048415 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:03.048469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048454 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-certificates\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048485 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-image-registry-private-configuration\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048510 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176a8b84-1d81-4b38-8410-df549e2516e5-tmp-dir\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.048697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048564 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hrd\" (UniqueName: \"kubernetes.io/projected/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-kube-api-access-j2hrd\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:03.048697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048600 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.048697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/176a8b84-1d81-4b38-8410-df549e2516e5-config-volume\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.048697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048672 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e26c3e6d-250f-4927-aea3-28470631f9f1-ca-trust-extracted\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048705 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37e71e4d-df15-49c1-b256-3a1a0ec2f639-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048735 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048759 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d485cd73-3de1-43b8-8191-08b7034e310f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048776 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-installation-pull-secrets\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048828 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvjqm\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-kube-api-access-hvjqm\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048866 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666952a3-1d54-4f34-8af4-be3d6b26c1cb-tmp\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048893 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-ca\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.048975 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048915 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.049260 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.048983 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2hl\" (UniqueName: \"kubernetes.io/projected/666952a3-1d54-4f34-8af4-be3d6b26c1cb-kube-api-access-jt2hl\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.049260 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.049021 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-hub\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.049260 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.049075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxj4n\" (UniqueName: \"kubernetes.io/projected/e2d7244a-2d38-4a97-9509-a6f23d1c9204-kube-api-access-lxj4n\") pod \"managed-serviceaccount-addon-agent-6975cd79b-k8whs\" (UID: \"e2d7244a-2d38-4a97-9509-a6f23d1c9204\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.150103 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150073 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-image-registry-private-configuration\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150116 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176a8b84-1d81-4b38-8410-df549e2516e5-tmp-dir\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150147 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hrd\" (UniqueName: \"kubernetes.io/projected/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-kube-api-access-j2hrd\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150177 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150196 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/176a8b84-1d81-4b38-8410-df549e2516e5-config-volume\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150300 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e26c3e6d-250f-4927-aea3-28470631f9f1-ca-trust-extracted\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150345 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37e71e4d-df15-49c1-b256-3a1a0ec2f639-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150374 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150398 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d485cd73-3de1-43b8-8191-08b7034e310f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150427 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-installation-pull-secrets\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150455 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvjqm\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-kube-api-access-hvjqm\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150488 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666952a3-1d54-4f34-8af4-be3d6b26c1cb-tmp\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150515 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-ca\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150524 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176a8b84-1d81-4b38-8410-df549e2516e5-tmp-dir\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.150570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150540 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150585 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2hl\" (UniqueName: \"kubernetes.io/projected/666952a3-1d54-4f34-8af4-be3d6b26c1cb-kube-api-access-jt2hl\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150618 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-hub\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150667 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxj4n\" (UniqueName: \"kubernetes.io/projected/e2d7244a-2d38-4a97-9509-a6f23d1c9204-kube-api-access-lxj4n\") pod \"managed-serviceaccount-addon-agent-6975cd79b-k8whs\" (UID: \"e2d7244a-2d38-4a97-9509-a6f23d1c9204\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150701 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-trusted-ca\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150726 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qspwv\" (UniqueName: \"kubernetes.io/projected/176a8b84-1d81-4b38-8410-df549e2516e5-kube-api-access-qspwv\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150758 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150795 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-bound-sa-token\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150847 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/666952a3-1d54-4f34-8af4-be3d6b26c1cb-klusterlet-config\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150851 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e26c3e6d-250f-4927-aea3-28470631f9f1-ca-trust-extracted\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.150874 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/176a8b84-1d81-4b38-8410-df549e2516e5-config-volume\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.150620 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:03.151116 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.150910 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151238 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d485cd73-3de1-43b8-8191-08b7034e310f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.151255 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151300 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.151316 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:03.651296607 +0000 UTC m=+35.084200300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151353 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2d7244a-2d38-4a97-9509-a6f23d1c9204-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6975cd79b-k8whs\" (UID: \"e2d7244a-2d38-4a97-9509-a6f23d1c9204\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.151379 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151392 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smccs\" (UniqueName: \"kubernetes.io/projected/d485cd73-3de1-43b8-8191-08b7034e310f-kube-api-access-smccs\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.151427 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:03.651411104 +0000 UTC m=+35.084314785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151497 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37e71e4d-df15-49c1-b256-3a1a0ec2f639-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151548 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:03.151665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151587 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-certificates\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.152219 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.151783 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666952a3-1d54-4f34-8af4-be3d6b26c1cb-tmp\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.152219 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.152101 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-certificates\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.152509 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.152469 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:03.652450577 +0000 UTC m=+35.085354268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:03.152752 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.152732 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:03.152865 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.152784 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:33:03.652769225 +0000 UTC m=+35.085672922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:03.153465 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.153382 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-trusted-ca\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.156056 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156030 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-image-registry-private-configuration\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.156056 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156038 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.156220 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156154 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/666952a3-1d54-4f34-8af4-be3d6b26c1cb-klusterlet-config\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.156276 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156253 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.156457 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156422 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-installation-pull-secrets\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.156573 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156556 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2d7244a-2d38-4a97-9509-a6f23d1c9204-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6975cd79b-k8whs\" (UID: \"e2d7244a-2d38-4a97-9509-a6f23d1c9204\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.156839 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.156802 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-hub\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.157770 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.157718 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d485cd73-3de1-43b8-8191-08b7034e310f-ca\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.159125 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.159081 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hrd\" (UniqueName: \"kubernetes.io/projected/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-kube-api-access-j2hrd\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:03.160453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.160396 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2hl\" (UniqueName: \"kubernetes.io/projected/666952a3-1d54-4f34-8af4-be3d6b26c1cb-kube-api-access-jt2hl\") pod \"klusterlet-addon-workmgr-67b95488ff-c6bbk\" (UID: \"666952a3-1d54-4f34-8af4-be3d6b26c1cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.160573 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.160525 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvjqm\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-kube-api-access-hvjqm\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.160665 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.160640 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxj4n\" (UniqueName: \"kubernetes.io/projected/e2d7244a-2d38-4a97-9509-a6f23d1c9204-kube-api-access-lxj4n\") pod \"managed-serviceaccount-addon-agent-6975cd79b-k8whs\" (UID: \"e2d7244a-2d38-4a97-9509-a6f23d1c9204\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.160930 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.160906 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-bound-sa-token\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.162047 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.162023 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smccs\" (UniqueName: \"kubernetes.io/projected/d485cd73-3de1-43b8-8191-08b7034e310f-kube-api-access-smccs\") pod \"cluster-proxy-proxy-agent-5d6dd44954-gpplw\" (UID: \"d485cd73-3de1-43b8-8191-08b7034e310f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.162630 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.162611 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspwv\" (UniqueName: \"kubernetes.io/projected/176a8b84-1d81-4b38-8410-df549e2516e5-kube-api-access-qspwv\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.218694 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.218657 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" May 21 17:33:03.240929 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.240900 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:03.248657 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.248641 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:33:03.655429 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.655394 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.655449 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.655519 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:03.655555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655576 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655595 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655625 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:03.655646 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655637 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:03.655967 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655642 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:03.655967 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655677 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:04.655654539 +0000 UTC m=+36.088558240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:03.655967 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655701 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:04.655689748 +0000 UTC m=+36.088593430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:03.655967 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655717 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:04.655707545 +0000 UTC m=+36.088611225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:03.655967 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:03.655734 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:33:04.655725237 +0000 UTC m=+36.088628923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:04.132664 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.132632 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:33:04.132664 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.132654 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:04.132904 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.132806 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:33:04.136214 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.136188 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 17:33:04.136346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.136237 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jx287\"" May 21 17:33:04.136346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.136252 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 17:33:04.136346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.136198 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 17:33:04.136346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.136292 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 17:33:04.136346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.136198 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2czh7\"" May 21 17:33:04.664796 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.664760 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.664894 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.664920 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.664938 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.664991 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.664973778 +0000 UTC m=+38.097877460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:04.665027 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665064 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665103 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665135 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.665117808 +0000 UTC m=+38.098021492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665156 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.665146548 +0000 UTC m=+38.098050233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665106 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665180 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:04.665275 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:04.665210 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.665202428 +0000 UTC m=+38.098106110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:05.225378 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.225318 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs"] May 21 17:33:05.230227 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:33:05.230197 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2d7244a_2d38_4a97_9509_a6f23d1c9204.slice/crio-20e25c030dd22bf9079f3a24fcf01a2937110894424a330c348d8a4c71464eb9 WatchSource:0}: Error finding container 20e25c030dd22bf9079f3a24fcf01a2937110894424a330c348d8a4c71464eb9: Status 404 returned error can't find the container with id 20e25c030dd22bf9079f3a24fcf01a2937110894424a330c348d8a4c71464eb9 May 21 17:33:05.235275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.235250 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk"] May 21 17:33:05.238626 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:33:05.238598 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666952a3_1d54_4f34_8af4_be3d6b26c1cb.slice/crio-84ac409b44e758bd1a04e3ecc2f4562a95b871e959d6e8ec90e08602e4517cc7 WatchSource:0}: Error finding container 84ac409b44e758bd1a04e3ecc2f4562a95b871e959d6e8ec90e08602e4517cc7: Status 404 returned error can't find the container with id 84ac409b44e758bd1a04e3ecc2f4562a95b871e959d6e8ec90e08602e4517cc7 May 21 17:33:05.241476 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.241447 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw"] May 21 17:33:05.247581 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:33:05.247544 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd485cd73_3de1_43b8_8191_08b7034e310f.slice/crio-4e1ba006500fc42c1c3dffec0ec3fc78b4cd77df710a7aaafae2377a2b436730 WatchSource:0}: Error finding container 4e1ba006500fc42c1c3dffec0ec3fc78b4cd77df710a7aaafae2377a2b436730: Status 404 returned error can't find the container with id 4e1ba006500fc42c1c3dffec0ec3fc78b4cd77df710a7aaafae2377a2b436730 May 21 17:33:05.287616 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.287582 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" event={"ID":"d485cd73-3de1-43b8-8191-08b7034e310f","Type":"ContainerStarted","Data":"4e1ba006500fc42c1c3dffec0ec3fc78b4cd77df710a7aaafae2377a2b436730"} May 21 17:33:05.288530 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.288508 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" event={"ID":"666952a3-1d54-4f34-8af4-be3d6b26c1cb","Type":"ContainerStarted","Data":"84ac409b44e758bd1a04e3ecc2f4562a95b871e959d6e8ec90e08602e4517cc7"} May 21 17:33:05.289358 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.289339 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" event={"ID":"e2d7244a-2d38-4a97-9509-a6f23d1c9204","Type":"ContainerStarted","Data":"20e25c030dd22bf9079f3a24fcf01a2937110894424a330c348d8a4c71464eb9"} May 21 17:33:05.371470 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.371443 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:33:05.374907 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.374722 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8d9b829-b7c1-470b-a0a2-e3464bf3162c-original-pull-secret\") pod \"global-pull-secret-syncer-kftnl\" (UID: \"f8d9b829-b7c1-470b-a0a2-e3464bf3162c\") " pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:33:05.644506 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.644473 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kftnl" May 21 17:33:05.763900 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:05.763872 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kftnl"] May 21 17:33:05.767201 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:33:05.767171 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d9b829_b7c1_470b_a0a2_e3464bf3162c.slice/crio-489f06d15c54043c8584b8c4e0bf8a52d3b98f80658743ff985499b308787acd WatchSource:0}: Error finding container 489f06d15c54043c8584b8c4e0bf8a52d3b98f80658743ff985499b308787acd: Status 404 returned error can't find the container with id 489f06d15c54043c8584b8c4e0bf8a52d3b98f80658743ff985499b308787acd May 21 17:33:06.296676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.296642 2551 generic.go:358] "Generic (PLEG): container finished" podID="a5cb6771-fcb6-41db-8fc7-98a4a975a6fb" containerID="4c5260604dcba3217f1a08908333b0bf02778412d6c50c46d53339af32e9e72d" exitCode=0 May 21 17:33:06.296836 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.296738 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerDied","Data":"4c5260604dcba3217f1a08908333b0bf02778412d6c50c46d53339af32e9e72d"} May 21 17:33:06.298636 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.298586 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kftnl" event={"ID":"f8d9b829-b7c1-470b-a0a2-e3464bf3162c","Type":"ContainerStarted","Data":"489f06d15c54043c8584b8c4e0bf8a52d3b98f80658743ff985499b308787acd"} May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.686015 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.686075 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.686169 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:06.686210 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686340 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686401 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:33:10.686382436 +0000 UTC m=+42.119286129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686808 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686840 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686890 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:10.686875125 +0000 UTC m=+42.119778805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686952 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.686981 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:10.686971184 +0000 UTC m=+42.119874870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.687031 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:06.687098 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:06.687060 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:10.687049091 +0000 UTC m=+42.119952771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:07.315766 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:07.314811 2551 generic.go:358] "Generic (PLEG): container finished" podID="a5cb6771-fcb6-41db-8fc7-98a4a975a6fb" containerID="7f2db275ce352f7041f78ba46fc8a5a7222eef0452e9d78b0620b27f7029f5fa" exitCode=0 May 21 17:33:07.315766 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:07.314917 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerDied","Data":"7f2db275ce352f7041f78ba46fc8a5a7222eef0452e9d78b0620b27f7029f5fa"} May 21 17:33:08.322201 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:08.322158 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l49m" event={"ID":"a5cb6771-fcb6-41db-8fc7-98a4a975a6fb","Type":"ContainerStarted","Data":"2541ba7e2395ef89458c08db17f6fcbbb72a47a307b71c5585fec1ff126be14d"} May 21 17:33:08.344740 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:08.344680 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2l49m" podStartSLOduration=6.156321481 podStartE2EDuration="39.34466193s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:32:32.076293703 +0000 UTC m=+3.509197396" lastFinishedPulling="2026-05-21 17:33:05.264634155 +0000 UTC m=+36.697537845" observedRunningTime="2026-05-21 17:33:08.343605446 +0000 UTC m=+39.776509150" watchObservedRunningTime="2026-05-21 17:33:08.34466193 +0000 UTC m=+39.777565635" May 21 17:33:10.724570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:10.724521 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:10.724570 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:10.724572 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:10.724612 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:10.724640 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724683 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724752 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724758 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724771 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:18.724749383 +0000 UTC m=+50.157653079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724776 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724803 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:18.724791435 +0000 UTC m=+50.157695128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724752 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724846 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:18.724833086 +0000 UTC m=+50.157736782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:10.725056 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:10.724862 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:33:18.724854731 +0000 UTC m=+50.157758414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:16.339784 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.339747 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" event={"ID":"e2d7244a-2d38-4a97-9509-a6f23d1c9204","Type":"ContainerStarted","Data":"032710329a7282f748f010b9e73c37fb017336b6c0cdc8f056475d2f34ed7f8b"} May 21 17:33:16.344701 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.344662 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kftnl" event={"ID":"f8d9b829-b7c1-470b-a0a2-e3464bf3162c","Type":"ContainerStarted","Data":"583d4f3606f4653e381835b9725161633c8dc6fb20a29d93f78d12a463d1f263"} May 21 17:33:16.346182 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.346137 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" event={"ID":"d485cd73-3de1-43b8-8191-08b7034e310f","Type":"ContainerStarted","Data":"3def5ab70ea82a068cd2a035560e5d17554df474335b9dcdbe730998d4817b15"} May 21 17:33:16.347507 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.347480 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" event={"ID":"666952a3-1d54-4f34-8af4-be3d6b26c1cb","Type":"ContainerStarted","Data":"217451d3546e95c481f27199192be667cc8aea4180b4f5acb8ddad5fcb7475e9"} May 21 17:33:16.347751 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.347732 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:16.349619 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.349587 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:33:16.354854 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.354790 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" podStartSLOduration=36.374928802 podStartE2EDuration="46.354775697s" podCreationTimestamp="2026-05-21 17:32:30 +0000 UTC" firstStartedPulling="2026-05-21 17:33:05.236931385 +0000 UTC m=+36.669835064" lastFinishedPulling="2026-05-21 17:33:15.216778274 +0000 UTC m=+46.649681959" observedRunningTime="2026-05-21 17:33:16.354342511 +0000 UTC m=+47.787246228" watchObservedRunningTime="2026-05-21 17:33:16.354775697 +0000 UTC m=+47.787679397" May 21 17:33:16.379995 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.379939 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kftnl" podStartSLOduration=33.887178964 podStartE2EDuration="43.379920111s" podCreationTimestamp="2026-05-21 17:32:33 +0000 UTC" firstStartedPulling="2026-05-21 17:33:05.768757735 +0000 UTC m=+37.201661414" lastFinishedPulling="2026-05-21 17:33:15.261498873 +0000 UTC m=+46.694402561" observedRunningTime="2026-05-21 17:33:16.366509928 +0000 UTC m=+47.799413630" watchObservedRunningTime="2026-05-21 17:33:16.379920111 +0000 UTC m=+47.812823814" May 21 17:33:16.380523 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:16.380492 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" podStartSLOduration=36.344347462 podStartE2EDuration="46.380481914s" podCreationTimestamp="2026-05-21 17:32:30 +0000 UTC" firstStartedPulling="2026-05-21 17:33:05.240770621 +0000 UTC m=+36.673674314" lastFinishedPulling="2026-05-21 17:33:15.276905087 +0000 UTC m=+46.709808766" observedRunningTime="2026-05-21 17:33:16.379812705 +0000 UTC m=+47.812716407" watchObservedRunningTime="2026-05-21 17:33:16.380481914 +0000 UTC m=+47.813385614" May 21 17:33:18.354127 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:18.354097 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" event={"ID":"d485cd73-3de1-43b8-8191-08b7034e310f","Type":"ContainerStarted","Data":"7383fdd973cf5aeedb0fefba3bc0e8efa11391233ac50d2b35a846050f1fb8ea"} May 21 17:33:18.354447 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:18.354134 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" event={"ID":"d485cd73-3de1-43b8-8191-08b7034e310f","Type":"ContainerStarted","Data":"ff83e7d9f4bcce844a95e55e5e04981910a0e1484a2f5ec7c5b4add5940757f9"} May 21 17:33:18.798965 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:18.798928 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:18.799007 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:18.799030 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:18.799056 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799072 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799149 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:34.799131025 +0000 UTC m=+66.232034711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799152 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:18.799184 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799165 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:18.799411 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799146 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:18.799411 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799209 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:34.799194792 +0000 UTC m=+66.232098472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:18.799411 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799150 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:18.799411 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799235 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:34.799223698 +0000 UTC m=+66.232127382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:18.799411 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:18.799249 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:33:34.799243315 +0000 UTC m=+66.232146997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:19.374095 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:19.374041 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" podStartSLOduration=36.467769645 podStartE2EDuration="49.37402725s" podCreationTimestamp="2026-05-21 17:32:30 +0000 UTC" firstStartedPulling="2026-05-21 17:33:05.249068913 +0000 UTC m=+36.681972592" lastFinishedPulling="2026-05-21 17:33:18.155326514 +0000 UTC m=+49.588230197" observedRunningTime="2026-05-21 17:33:19.37280024 +0000 UTC m=+50.805703943" watchObservedRunningTime="2026-05-21 17:33:19.37402725 +0000 UTC m=+50.806930951" May 21 17:33:28.281804 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:28.281770 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lbkh6" May 21 17:33:34.829269 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:34.829228 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:33:34.829269 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:34.829274 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829365 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829370 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829418 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:06.829405324 +0000 UTC m=+98.262309003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:34.829415 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829432 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:06.829425131 +0000 UTC m=+98.262328809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:34.829468 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829512 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829527 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829541 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829561 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:06.82955506 +0000 UTC m=+98.262458739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:33:34.829853 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.829571 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:06.829565837 +0000 UTC m=+98.262469516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:33:34.930573 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:34.930539 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:33:34.933235 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:34.933210 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 17:33:34.940996 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.940977 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 17:33:34.941074 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:33:34.941035 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:38.941020005 +0000 UTC m=+130.373923683 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : secret "metrics-daemon-secret" not found May 21 17:33:35.031707 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.031663 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:35.033914 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.033891 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 17:33:35.044438 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.044415 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 17:33:35.055380 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.055339 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97tks\" (UniqueName: \"kubernetes.io/projected/b9b95f2b-9aee-4004-b48e-d812dfb5b321-kube-api-access-97tks\") pod \"network-check-target-rzr9r\" (UID: \"b9b95f2b-9aee-4004-b48e-d812dfb5b321\") " pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:35.354364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.354329 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2czh7\"" May 21 17:33:35.362336 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.362307 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:35.487338 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:35.487307 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rzr9r"] May 21 17:33:35.490541 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:33:35.490509 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b95f2b_9aee_4004_b48e_d812dfb5b321.slice/crio-8383aa1872dc089151c0db0734338ca1b259dae92a3110b2fe28582af1c45086 WatchSource:0}: Error finding container 8383aa1872dc089151c0db0734338ca1b259dae92a3110b2fe28582af1c45086: Status 404 returned error can't find the container with id 8383aa1872dc089151c0db0734338ca1b259dae92a3110b2fe28582af1c45086 May 21 17:33:36.398272 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:36.398232 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rzr9r" event={"ID":"b9b95f2b-9aee-4004-b48e-d812dfb5b321","Type":"ContainerStarted","Data":"8383aa1872dc089151c0db0734338ca1b259dae92a3110b2fe28582af1c45086"} May 21 17:33:39.407857 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:39.407801 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rzr9r" event={"ID":"b9b95f2b-9aee-4004-b48e-d812dfb5b321","Type":"ContainerStarted","Data":"7603ba3d057d9397e2d99fdf3ccd13914ad4751d0aa83a24a743b35cb372551b"} May 21 17:33:39.408231 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:39.407945 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:33:39.421273 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:33:39.421226 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rzr9r" podStartSLOduration=66.895710108 podStartE2EDuration="1m10.421213423s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:33:35.4923041 +0000 UTC m=+66.925207779" lastFinishedPulling="2026-05-21 17:33:39.01780741 +0000 UTC m=+70.450711094" observedRunningTime="2026-05-21 17:33:39.421193662 +0000 UTC m=+70.854097362" watchObservedRunningTime="2026-05-21 17:33:39.421213423 +0000 UTC m=+70.854117118" May 21 17:34:06.888236 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:06.888195 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:06.888254 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:06.888319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:06.888353 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888384 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888411 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888422 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888452 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888428 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888482 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:10.888465728 +0000 UTC m=+162.321369407 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888509 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:10.888492786 +0000 UTC m=+162.321396481 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888535 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:10.888525076 +0000 UTC m=+162.321428756 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:34:06.888762 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:06.888556 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:10.888546888 +0000 UTC m=+162.321450568 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:34:10.412826 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:10.412797 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rzr9r" May 21 17:34:38.941927 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:38.941888 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:34:38.942405 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:38.942040 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 17:34:38.942405 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:34:38.942118 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs podName:52dede10-d44d-4fda-9cc3-9e0f726a3117 nodeName:}" failed. No retries permitted until 2026-05-21 17:36:40.942099961 +0000 UTC m=+252.375003658 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs") pod "network-metrics-daemon-ww4l5" (UID: "52dede10-d44d-4fda-9cc3-9e0f726a3117") : secret "metrics-daemon-secret" not found May 21 17:34:53.736371 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:53.736338 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cgjpr_8e30383e-0967-4e33-9837-90aa0c04a17f/dns-node-resolver/0.log" May 21 17:34:54.314914 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:34:54.314885 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lj7vp_80c57e38-682f-414c-898e-a523f6587e1c/node-ca/0.log" May 21 17:35:04.964664 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.964629 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ww8f9"] May 21 17:35:04.966730 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.966711 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:04.969019 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.968997 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 17:35:04.969161 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.969143 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 17:35:04.970117 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.970095 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 17:35:04.970220 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.970100 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 17:35:04.970220 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.970119 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cqc5t\"" May 21 17:35:04.976103 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:04.976081 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ww8f9"] May 21 17:35:05.051083 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.051045 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.051083 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.051083 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-crio-socket\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.051312 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.051121 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.051312 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.051209 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnvbj\" (UniqueName: \"kubernetes.io/projected/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-kube-api-access-pnvbj\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.051312 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.051263 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-data-volume\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.151789 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.151754 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152004 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.151800 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnvbj\" (UniqueName: \"kubernetes.io/projected/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-kube-api-access-pnvbj\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152004 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.151925 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:05.152004 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.151993 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls podName:1281f6fb-7e59-409f-8144-5d8f9aa8eab2 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:05.651974468 +0000 UTC m=+157.084878175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww8f9" (UID: "1281f6fb-7e59-409f-8144-5d8f9aa8eab2") : secret "insights-runtime-extractor-tls" not found May 21 17:35:05.152200 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.152018 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-data-volume\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152200 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.152122 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152200 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.152161 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-crio-socket\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152333 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.152251 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-crio-socket\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152366 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.152347 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-data-volume\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.152575 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.152557 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.159994 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.159968 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnvbj\" (UniqueName: \"kubernetes.io/projected/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-kube-api-access-pnvbj\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.656945 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:05.656908 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:05.657150 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.657089 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:05.657217 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.657178 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls podName:1281f6fb-7e59-409f-8144-5d8f9aa8eab2 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:06.657157981 +0000 UTC m=+158.090061659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww8f9" (UID: "1281f6fb-7e59-409f-8144-5d8f9aa8eab2") : secret "insights-runtime-extractor-tls" not found May 21 17:35:05.927685 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.927593 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" podUID="37e71e4d-df15-49c1-b256-3a1a0ec2f639" May 21 17:35:05.933740 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.933710 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" podUID="e26c3e6d-250f-4927-aea3-28470631f9f1" May 21 17:35:05.963264 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.963220 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-92v7g" podUID="db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d" May 21 17:35:05.969740 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:05.969711 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rk78k" podUID="176a8b84-1d81-4b38-8410-df549e2516e5" May 21 17:35:06.607791 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:06.607714 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:35:06.607956 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:06.607714 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:35:06.607956 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:06.607714 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk78k" May 21 17:35:06.607956 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:06.607719 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:35:06.667127 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:06.666989 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:06.667127 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:06.667085 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:06.667346 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:06.667159 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls podName:1281f6fb-7e59-409f-8144-5d8f9aa8eab2 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:08.667139693 +0000 UTC m=+160.100043379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww8f9" (UID: "1281f6fb-7e59-409f-8144-5d8f9aa8eab2") : secret "insights-runtime-extractor-tls" not found May 21 17:35:07.159130 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:07.159089 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ww4l5" podUID="52dede10-d44d-4fda-9cc3-9e0f726a3117" May 21 17:35:08.681435 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:08.681387 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:08.681851 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:08.681542 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:08.681851 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:08.681626 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls podName:1281f6fb-7e59-409f-8144-5d8f9aa8eab2 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:12.681609419 +0000 UTC m=+164.114513098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww8f9" (UID: "1281f6fb-7e59-409f-8144-5d8f9aa8eab2") : secret "insights-runtime-extractor-tls" not found May 21 17:35:10.899080 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:10.899044 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") pod \"image-registry-6c9f96476-pj9c9\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:10.899097 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:10.899151 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:10.899177 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899205 2551 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899223 2551 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c9f96476-pj9c9: secret "image-registry-tls" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899273 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899281 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899273 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899277 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls podName:e26c3e6d-250f-4927-aea3-28470631f9f1 nodeName:}" failed. No retries permitted until 2026-05-21 17:37:12.899262347 +0000 UTC m=+284.332166025 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls") pod "image-registry-6c9f96476-pj9c9" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1") : secret "image-registry-tls" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899349 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert podName:db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d nodeName:}" failed. No retries permitted until 2026-05-21 17:37:12.899338285 +0000 UTC m=+284.332241965 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert") pod "ingress-canary-92v7g" (UID: "db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d") : secret "canary-serving-cert" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899361 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert podName:37e71e4d-df15-49c1-b256-3a1a0ec2f639 nodeName:}" failed. No retries permitted until 2026-05-21 17:37:12.899353201 +0000 UTC m=+284.332256879 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6tj6x" (UID: "37e71e4d-df15-49c1-b256-3a1a0ec2f639") : secret "networking-console-plugin-cert" not found May 21 17:35:10.899574 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:10.899370 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls podName:176a8b84-1d81-4b38-8410-df549e2516e5 nodeName:}" failed. No retries permitted until 2026-05-21 17:37:12.899365438 +0000 UTC m=+284.332269117 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls") pod "dns-default-rk78k" (UID: "176a8b84-1d81-4b38-8410-df549e2516e5") : secret "dns-default-metrics-tls" not found May 21 17:35:12.714218 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:12.714183 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:12.714597 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:12.714337 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 17:35:12.714597 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:12.714402 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls podName:1281f6fb-7e59-409f-8144-5d8f9aa8eab2 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:20.714388285 +0000 UTC m=+172.147291964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww8f9" (UID: "1281f6fb-7e59-409f-8144-5d8f9aa8eab2") : secret "insights-runtime-extractor-tls" not found May 21 17:35:15.630136 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:15.630098 2551 generic.go:358] "Generic (PLEG): container finished" podID="666952a3-1d54-4f34-8af4-be3d6b26c1cb" containerID="217451d3546e95c481f27199192be667cc8aea4180b4f5acb8ddad5fcb7475e9" exitCode=1 May 21 17:35:15.630610 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:15.630178 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" event={"ID":"666952a3-1d54-4f34-8af4-be3d6b26c1cb","Type":"ContainerDied","Data":"217451d3546e95c481f27199192be667cc8aea4180b4f5acb8ddad5fcb7475e9"} May 21 17:35:15.630610 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:15.630604 2551 scope.go:117] "RemoveContainer" containerID="217451d3546e95c481f27199192be667cc8aea4180b4f5acb8ddad5fcb7475e9" May 21 17:35:15.631542 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:15.631519 2551 generic.go:358] "Generic (PLEG): container finished" podID="e2d7244a-2d38-4a97-9509-a6f23d1c9204" containerID="032710329a7282f748f010b9e73c37fb017336b6c0cdc8f056475d2f34ed7f8b" exitCode=255 May 21 17:35:15.631635 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:15.631600 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" event={"ID":"e2d7244a-2d38-4a97-9509-a6f23d1c9204","Type":"ContainerDied","Data":"032710329a7282f748f010b9e73c37fb017336b6c0cdc8f056475d2f34ed7f8b"} May 21 17:35:15.631947 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:15.631928 2551 scope.go:117] "RemoveContainer" containerID="032710329a7282f748f010b9e73c37fb017336b6c0cdc8f056475d2f34ed7f8b" May 21 17:35:16.348583 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:16.348546 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:35:16.638430 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:16.638384 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" event={"ID":"666952a3-1d54-4f34-8af4-be3d6b26c1cb","Type":"ContainerStarted","Data":"0567b333eb927138cf0ac6e100d3ca8db45e11fe18bec42361e0f255804c8b84"} May 21 17:35:16.638945 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:16.638571 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:35:16.639365 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:16.639339 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67b95488ff-c6bbk" May 21 17:35:16.640118 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:16.640093 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6975cd79b-k8whs" event={"ID":"e2d7244a-2d38-4a97-9509-a6f23d1c9204","Type":"ContainerStarted","Data":"760b84af9c3a709dc19f549bb08e0e929ddba997ce9013b5ebc7530c9a77811f"} May 21 17:35:20.132797 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:20.132745 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:35:20.786414 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:20.786373 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:20.788862 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:20.788801 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1281f6fb-7e59-409f-8144-5d8f9aa8eab2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww8f9\" (UID: \"1281f6fb-7e59-409f-8144-5d8f9aa8eab2\") " pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:20.874908 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:20.874869 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ww8f9" May 21 17:35:20.998870 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:20.998835 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ww8f9"] May 21 17:35:21.002330 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:35:21.002304 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1281f6fb_7e59_409f_8144_5d8f9aa8eab2.slice/crio-6422c2a757d0d47157195366efbf4837e088d20b42f717ff09de61abdcf3ee59 WatchSource:0}: Error finding container 6422c2a757d0d47157195366efbf4837e088d20b42f717ff09de61abdcf3ee59: Status 404 returned error can't find the container with id 6422c2a757d0d47157195366efbf4837e088d20b42f717ff09de61abdcf3ee59 May 21 17:35:21.654354 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:21.654320 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww8f9" event={"ID":"1281f6fb-7e59-409f-8144-5d8f9aa8eab2","Type":"ContainerStarted","Data":"9f03871526855b0072ae812934242253c73d87c04e7c48e464255b52ebb5d039"} May 21 17:35:21.654354 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:21.654357 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww8f9" event={"ID":"1281f6fb-7e59-409f-8144-5d8f9aa8eab2","Type":"ContainerStarted","Data":"6422c2a757d0d47157195366efbf4837e088d20b42f717ff09de61abdcf3ee59"} May 21 17:35:22.659418 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:22.659376 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww8f9" event={"ID":"1281f6fb-7e59-409f-8144-5d8f9aa8eab2","Type":"ContainerStarted","Data":"81382721539aacf088512319269b216373ed3665b2146f7cf0b14279667386d0"} May 21 17:35:23.663744 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:23.663709 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww8f9" event={"ID":"1281f6fb-7e59-409f-8144-5d8f9aa8eab2","Type":"ContainerStarted","Data":"bae07119a3bccb0a8fdf084cf001f244d879955b9049f4507c9aa8be7bcadb21"} May 21 17:35:23.679441 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:23.679370 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ww8f9" podStartSLOduration=17.516808063 podStartE2EDuration="19.679352082s" podCreationTimestamp="2026-05-21 17:35:04 +0000 UTC" firstStartedPulling="2026-05-21 17:35:21.065173688 +0000 UTC m=+172.498077374" lastFinishedPulling="2026-05-21 17:35:23.227717714 +0000 UTC m=+174.660621393" observedRunningTime="2026-05-21 17:35:23.678728003 +0000 UTC m=+175.111631706" watchObservedRunningTime="2026-05-21 17:35:23.679352082 +0000 UTC m=+175.112255784" May 21 17:35:31.824278 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.824240 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xcfwr"] May 21 17:35:31.826348 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.826330 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.829106 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.829078 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 17:35:31.829237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.829107 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 17:35:31.829411 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.829396 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 17:35:31.830190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.829925 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 17:35:31.833695 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.833658 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 17:35:31.833848 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.833764 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h42qc\"" May 21 17:35:31.833848 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.833785 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 17:35:31.983216 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983178 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983425 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983228 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-root\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983425 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983293 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983425 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983359 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-wtmp\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983425 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983384 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-textfile\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983425 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983409 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kvtl\" (UniqueName: \"kubernetes.io/projected/15c1335c-5b84-42aa-87bc-7e6a162c821d-kube-api-access-5kvtl\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983441 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-sys\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983457 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c1335c-5b84-42aa-87bc-7e6a162c821d-metrics-client-ca\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:31.983601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:31.983494 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.084770 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084671 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-root\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.084770 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084722 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084779 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-root\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084787 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-wtmp\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084876 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-textfile\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084902 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kvtl\" (UniqueName: \"kubernetes.io/projected/15c1335c-5b84-42aa-87bc-7e6a162c821d-kube-api-access-5kvtl\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084939 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-wtmp\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:32.084940 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084985 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-sys\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.084955 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15c1335c-5b84-42aa-87bc-7e6a162c821d-sys\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085011 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:32.085015 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls podName:15c1335c-5b84-42aa-87bc-7e6a162c821d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:32.584994988 +0000 UTC m=+184.017898677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls") pod "node-exporter-xcfwr" (UID: "15c1335c-5b84-42aa-87bc-7e6a162c821d") : secret "node-exporter-tls" not found May 21 17:35:32.085326 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.085072 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c1335c-5b84-42aa-87bc-7e6a162c821d-metrics-client-ca\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085326 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.085137 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085326 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.085176 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085326 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.085200 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-textfile\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085671 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.085648 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c1335c-5b84-42aa-87bc-7e6a162c821d-metrics-client-ca\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.085721 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.085701 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.087526 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.087507 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.093165 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.093141 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kvtl\" (UniqueName: \"kubernetes.io/projected/15c1335c-5b84-42aa-87bc-7e6a162c821d-kube-api-access-5kvtl\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.589842 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:32.589769 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:32.590035 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:32.589940 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 17:35:32.590035 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:32.590019 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls podName:15c1335c-5b84-42aa-87bc-7e6a162c821d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:33.590004203 +0000 UTC m=+185.022907886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls") pod "node-exporter-xcfwr" (UID: "15c1335c-5b84-42aa-87bc-7e6a162c821d") : secret "node-exporter-tls" not found May 21 17:35:33.599407 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:33.599354 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:33.601643 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:33.601622 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/15c1335c-5b84-42aa-87bc-7e6a162c821d-node-exporter-tls\") pod \"node-exporter-xcfwr\" (UID: \"15c1335c-5b84-42aa-87bc-7e6a162c821d\") " pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:33.639742 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:33.639700 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcfwr" May 21 17:35:33.647665 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:35:33.647626 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c1335c_5b84_42aa_87bc_7e6a162c821d.slice/crio-8192968374d2995c7bb5046a0c01f342d09633a0a9e3d3538316d39b1d546489 WatchSource:0}: Error finding container 8192968374d2995c7bb5046a0c01f342d09633a0a9e3d3538316d39b1d546489: Status 404 returned error can't find the container with id 8192968374d2995c7bb5046a0c01f342d09633a0a9e3d3538316d39b1d546489 May 21 17:35:33.688777 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:33.688744 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcfwr" event={"ID":"15c1335c-5b84-42aa-87bc-7e6a162c821d","Type":"ContainerStarted","Data":"8192968374d2995c7bb5046a0c01f342d09633a0a9e3d3538316d39b1d546489"} May 21 17:35:35.694646 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:35.694612 2551 generic.go:358] "Generic (PLEG): container finished" podID="15c1335c-5b84-42aa-87bc-7e6a162c821d" containerID="f6019d11605d37bb579d5ae55a331ac1ee40f150ff5a48da6024eecc78b3b444" exitCode=0 May 21 17:35:35.695086 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:35.694657 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcfwr" event={"ID":"15c1335c-5b84-42aa-87bc-7e6a162c821d","Type":"ContainerDied","Data":"f6019d11605d37bb579d5ae55a331ac1ee40f150ff5a48da6024eecc78b3b444"} May 21 17:35:36.698223 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:36.698191 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcfwr" event={"ID":"15c1335c-5b84-42aa-87bc-7e6a162c821d","Type":"ContainerStarted","Data":"da98691ade109774bcc9e358b2d2daf67fa791e83e368f00cd49663214272d46"} May 21 17:35:36.698223 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:36.698229 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcfwr" event={"ID":"15c1335c-5b84-42aa-87bc-7e6a162c821d","Type":"ContainerStarted","Data":"8b6e8d8c17efa886097076f2b7a94e8c5ef8b08a7faeaa3a75f785e0ba303dff"} May 21 17:35:36.717102 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:36.717051 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xcfwr" podStartSLOduration=4.680933432 podStartE2EDuration="5.717035271s" podCreationTimestamp="2026-05-21 17:35:31 +0000 UTC" firstStartedPulling="2026-05-21 17:35:33.649486799 +0000 UTC m=+185.082390478" lastFinishedPulling="2026-05-21 17:35:34.685588634 +0000 UTC m=+186.118492317" observedRunningTime="2026-05-21 17:35:36.715628179 +0000 UTC m=+188.148531902" watchObservedRunningTime="2026-05-21 17:35:36.717035271 +0000 UTC m=+188.149938971" May 21 17:35:46.342536 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.342495 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c9f96476-pj9c9"] May 21 17:35:46.342962 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:35:46.342709 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" podUID="e26c3e6d-250f-4927-aea3-28470631f9f1" May 21 17:35:46.723146 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.723108 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:35:46.727205 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.727179 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:35:46.809457 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809401 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-image-registry-private-configuration\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.809648 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809483 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvjqm\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-kube-api-access-hvjqm\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.809648 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809577 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-installation-pull-secrets\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.809648 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809621 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-trusted-ca\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.809648 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809642 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-bound-sa-token\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.809892 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809669 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e26c3e6d-250f-4927-aea3-28470631f9f1-ca-trust-extracted\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.809892 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.809699 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-certificates\") pod \"e26c3e6d-250f-4927-aea3-28470631f9f1\" (UID: \"e26c3e6d-250f-4927-aea3-28470631f9f1\") " May 21 17:35:46.810035 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.810004 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e26c3e6d-250f-4927-aea3-28470631f9f1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:35:46.810183 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.810151 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:35:46.810254 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.810195 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:35:46.811850 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.811808 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:35:46.811958 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.811877 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-kube-api-access-hvjqm" (OuterVolumeSpecName: "kube-api-access-hvjqm") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "kube-api-access-hvjqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:35:46.812101 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.812082 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 17:35:46.812139 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.812104 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e26c3e6d-250f-4927-aea3-28470631f9f1" (UID: "e26c3e6d-250f-4927-aea3-28470631f9f1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:35:46.910460 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910416 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-image-registry-private-configuration\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:46.910460 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910449 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvjqm\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-kube-api-access-hvjqm\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:46.910460 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910459 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e26c3e6d-250f-4927-aea3-28470631f9f1-installation-pull-secrets\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:46.910460 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910468 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-trusted-ca\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:46.910722 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910478 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-bound-sa-token\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:46.910722 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910487 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e26c3e6d-250f-4927-aea3-28470631f9f1-ca-trust-extracted\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:46.910722 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:46.910495 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-certificates\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:47.724945 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:47.724916 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c9f96476-pj9c9" May 21 17:35:47.754802 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:47.754767 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c9f96476-pj9c9"] May 21 17:35:47.760098 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:47.760069 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c9f96476-pj9c9"] May 21 17:35:47.826696 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:47.826656 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e26c3e6d-250f-4927-aea3-28470631f9f1-registry-tls\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:35:49.135410 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:35:49.135375 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e26c3e6d-250f-4927-aea3-28470631f9f1" path="/var/lib/kubelet/pods/e26c3e6d-250f-4927-aea3-28470631f9f1/volumes" May 21 17:36:23.252954 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:23.252893 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" podUID="d485cd73-3de1-43b8-8191-08b7034e310f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 17:36:33.250403 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:33.250362 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" podUID="d485cd73-3de1-43b8-8191-08b7034e310f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 17:36:40.956594 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:40.956553 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:36:40.958788 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:40.958767 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52dede10-d44d-4fda-9cc3-9e0f726a3117-metrics-certs\") pod \"network-metrics-daemon-ww4l5\" (UID: \"52dede10-d44d-4fda-9cc3-9e0f726a3117\") " pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:36:41.136128 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:41.136100 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jx287\"" May 21 17:36:41.143945 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:41.143925 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ww4l5" May 21 17:36:41.261628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:41.261592 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ww4l5"] May 21 17:36:41.264782 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:36:41.264754 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dede10_d44d_4fda_9cc3_9e0f726a3117.slice/crio-fe31ce168fba946f016a699c54ba5324beb32fe97978708bc8f4ef27a7f61222 WatchSource:0}: Error finding container fe31ce168fba946f016a699c54ba5324beb32fe97978708bc8f4ef27a7f61222: Status 404 returned error can't find the container with id fe31ce168fba946f016a699c54ba5324beb32fe97978708bc8f4ef27a7f61222 May 21 17:36:41.864407 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:41.864359 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ww4l5" event={"ID":"52dede10-d44d-4fda-9cc3-9e0f726a3117","Type":"ContainerStarted","Data":"fe31ce168fba946f016a699c54ba5324beb32fe97978708bc8f4ef27a7f61222"} May 21 17:36:42.868776 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:42.868676 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ww4l5" event={"ID":"52dede10-d44d-4fda-9cc3-9e0f726a3117","Type":"ContainerStarted","Data":"4dc094a8e69e771fa58cbeb32b97feb0963892f1dc13ddf05bf0373a7a110871"} May 21 17:36:42.868776 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:42.868714 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ww4l5" event={"ID":"52dede10-d44d-4fda-9cc3-9e0f726a3117","Type":"ContainerStarted","Data":"1e446d11ee0b250f8da94965c626a1bc8e6bf79ee42b295e050f444be289c7cc"} May 21 17:36:42.885187 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:42.885138 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ww4l5" podStartSLOduration=252.748969285 podStartE2EDuration="4m13.885123217s" podCreationTimestamp="2026-05-21 17:32:29 +0000 UTC" firstStartedPulling="2026-05-21 17:36:41.266520963 +0000 UTC m=+252.699424643" lastFinishedPulling="2026-05-21 17:36:42.402674893 +0000 UTC m=+253.835578575" observedRunningTime="2026-05-21 17:36:42.883477017 +0000 UTC m=+254.316380753" watchObservedRunningTime="2026-05-21 17:36:42.885123217 +0000 UTC m=+254.318026918" May 21 17:36:43.250239 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.250200 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" podUID="d485cd73-3de1-43b8-8191-08b7034e310f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 17:36:43.250432 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.250268 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" May 21 17:36:43.250765 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.250718 2551 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7383fdd973cf5aeedb0fefba3bc0e8efa11391233ac50d2b35a846050f1fb8ea"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 17:36:43.250888 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.250799 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" podUID="d485cd73-3de1-43b8-8191-08b7034e310f" containerName="service-proxy" containerID="cri-o://7383fdd973cf5aeedb0fefba3bc0e8efa11391233ac50d2b35a846050f1fb8ea" gracePeriod=30 May 21 17:36:43.875591 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.875553 2551 generic.go:358] "Generic (PLEG): container finished" podID="d485cd73-3de1-43b8-8191-08b7034e310f" containerID="7383fdd973cf5aeedb0fefba3bc0e8efa11391233ac50d2b35a846050f1fb8ea" exitCode=2 May 21 17:36:43.875961 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.875621 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" event={"ID":"d485cd73-3de1-43b8-8191-08b7034e310f","Type":"ContainerDied","Data":"7383fdd973cf5aeedb0fefba3bc0e8efa11391233ac50d2b35a846050f1fb8ea"} May 21 17:36:43.875961 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:36:43.875651 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d6dd44954-gpplw" event={"ID":"d485cd73-3de1-43b8-8191-08b7034e310f","Type":"ContainerStarted","Data":"edc512c4ab9dba3a1a710ac50f59d061eed65d7ffee1b438db88c9289a363f1a"} May 21 17:37:09.608601 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:37:09.608539 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" podUID="37e71e4d-df15-49c1-b256-3a1a0ec2f639" May 21 17:37:09.608601 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:37:09.608550 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-92v7g" podUID="db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d" May 21 17:37:09.608601 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:37:09.608569 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rk78k" podUID="176a8b84-1d81-4b38-8410-df549e2516e5" May 21 17:37:09.939305 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:09.939280 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:37:09.939472 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:09.939315 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk78k" May 21 17:37:09.939472 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:09.939332 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:37:12.916715 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.916663 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:37:12.916715 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.916719 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:37:12.917262 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.916763 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:37:12.919285 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.919252 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/176a8b84-1d81-4b38-8410-df549e2516e5-metrics-tls\") pod \"dns-default-rk78k\" (UID: \"176a8b84-1d81-4b38-8410-df549e2516e5\") " pod="openshift-dns/dns-default-rk78k" May 21 17:37:12.919428 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.919405 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d-cert\") pod \"ingress-canary-92v7g\" (UID: \"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d\") " pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:37:12.919470 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.919405 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37e71e4d-df15-49c1-b256-3a1a0ec2f639-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6tj6x\" (UID: \"37e71e4d-df15-49c1-b256-3a1a0ec2f639\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:37:12.944072 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.944041 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9kjgp\"" May 21 17:37:12.944072 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.944041 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhpf9\"" May 21 17:37:12.944318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.944041 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rz88\"" May 21 17:37:12.950734 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.950701 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" May 21 17:37:12.950909 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.950736 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk78k" May 21 17:37:12.950959 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:12.950706 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-92v7g" May 21 17:37:13.097477 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:13.097447 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rk78k"] May 21 17:37:13.100465 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:37:13.100418 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176a8b84_1d81_4b38_8410_df549e2516e5.slice/crio-67c6a85c0291ad1d65b8684093f401330bc4a2170e8e5389c14738261c5bbf9a WatchSource:0}: Error finding container 67c6a85c0291ad1d65b8684093f401330bc4a2170e8e5389c14738261c5bbf9a: Status 404 returned error can't find the container with id 67c6a85c0291ad1d65b8684093f401330bc4a2170e8e5389c14738261c5bbf9a May 21 17:37:13.115741 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:13.115228 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-92v7g"] May 21 17:37:13.117541 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:37:13.117508 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5d596d_cdb6_4684_90c8_7a0cd7cb9e0d.slice/crio-29fb9150214ce9ba6749325466a2463622dc1d7fc2dc0f6d95d7141618fb9224 WatchSource:0}: Error finding container 29fb9150214ce9ba6749325466a2463622dc1d7fc2dc0f6d95d7141618fb9224: Status 404 returned error can't find the container with id 29fb9150214ce9ba6749325466a2463622dc1d7fc2dc0f6d95d7141618fb9224 May 21 17:37:13.131283 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:13.131252 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x"] May 21 17:37:13.134707 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:37:13.134676 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e71e4d_df15_49c1_b256_3a1a0ec2f639.slice/crio-e188b61cd5fdf7d5a6659047a313cbfbbe8c7b040e6c289f7477d5c531d1cd8c WatchSource:0}: Error finding container e188b61cd5fdf7d5a6659047a313cbfbbe8c7b040e6c289f7477d5c531d1cd8c: Status 404 returned error can't find the container with id e188b61cd5fdf7d5a6659047a313cbfbbe8c7b040e6c289f7477d5c531d1cd8c May 21 17:37:13.950940 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:13.950871 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-92v7g" event={"ID":"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d","Type":"ContainerStarted","Data":"29fb9150214ce9ba6749325466a2463622dc1d7fc2dc0f6d95d7141618fb9224"} May 21 17:37:13.952574 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:13.952539 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rk78k" event={"ID":"176a8b84-1d81-4b38-8410-df549e2516e5","Type":"ContainerStarted","Data":"67c6a85c0291ad1d65b8684093f401330bc4a2170e8e5389c14738261c5bbf9a"} May 21 17:37:13.953959 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:13.953916 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" event={"ID":"37e71e4d-df15-49c1-b256-3a1a0ec2f639","Type":"ContainerStarted","Data":"e188b61cd5fdf7d5a6659047a313cbfbbe8c7b040e6c289f7477d5c531d1cd8c"} May 21 17:37:15.965737 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.965699 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-92v7g" event={"ID":"db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d","Type":"ContainerStarted","Data":"30229c5213cfcba43ce3cd6e2ab7ad73721fbcb509861c9858fcdd49059a4d1b"} May 21 17:37:15.967361 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.967338 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rk78k" event={"ID":"176a8b84-1d81-4b38-8410-df549e2516e5","Type":"ContainerStarted","Data":"1d752d25a9078d01edac87486d4b4aef98f34a44e80f8bab0e2977b08002f38d"} May 21 17:37:15.967495 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.967367 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rk78k" event={"ID":"176a8b84-1d81-4b38-8410-df549e2516e5","Type":"ContainerStarted","Data":"c7f870374adec2e9e109f861a207f262d6051684ed425cbc08ed0e8cdee8a1c6"} May 21 17:37:15.967495 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.967470 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rk78k" May 21 17:37:15.968595 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.968570 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" event={"ID":"37e71e4d-df15-49c1-b256-3a1a0ec2f639","Type":"ContainerStarted","Data":"4e78198d583676fd618964bed8f83c0effd1a3eba401cf2dab69950abda2deb5"} May 21 17:37:15.980688 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.980634 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-92v7g" podStartSLOduration=251.731735405 podStartE2EDuration="4m13.98062129s" podCreationTimestamp="2026-05-21 17:33:02 +0000 UTC" firstStartedPulling="2026-05-21 17:37:13.119503004 +0000 UTC m=+284.552406696" lastFinishedPulling="2026-05-21 17:37:15.368388888 +0000 UTC m=+286.801292581" observedRunningTime="2026-05-21 17:37:15.97949812 +0000 UTC m=+287.412401822" watchObservedRunningTime="2026-05-21 17:37:15.98062129 +0000 UTC m=+287.413524991" May 21 17:37:15.994671 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:15.994620 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-rk78k" podStartSLOduration=251.732731991 podStartE2EDuration="4m13.994603553s" podCreationTimestamp="2026-05-21 17:33:02 +0000 UTC" firstStartedPulling="2026-05-21 17:37:13.103110356 +0000 UTC m=+284.536014035" lastFinishedPulling="2026-05-21 17:37:15.364981913 +0000 UTC m=+286.797885597" observedRunningTime="2026-05-21 17:37:15.993234322 +0000 UTC m=+287.426138024" watchObservedRunningTime="2026-05-21 17:37:15.994603553 +0000 UTC m=+287.427507258" May 21 17:37:16.007657 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:16.007493 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6tj6x" podStartSLOduration=263.7815052 podStartE2EDuration="4m26.007474028s" podCreationTimestamp="2026-05-21 17:32:50 +0000 UTC" firstStartedPulling="2026-05-21 17:37:13.136626596 +0000 UTC m=+284.569530277" lastFinishedPulling="2026-05-21 17:37:15.362595411 +0000 UTC m=+286.795499105" observedRunningTime="2026-05-21 17:37:16.007043065 +0000 UTC m=+287.439946767" watchObservedRunningTime="2026-05-21 17:37:16.007474028 +0000 UTC m=+287.440377730" May 21 17:37:25.973753 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:25.973715 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rk78k" May 21 17:37:29.089306 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:29.089278 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:37:29.089799 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:29.089779 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:37:29.091713 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:37:29.091693 2551 kubelet.go:1628] "Image garbage collection succeeded" May 21 17:38:51.551562 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.551522 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x"] May 21 17:38:51.553477 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.553458 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.556117 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.556095 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 17:38:51.556234 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.556144 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 17:38:51.557208 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.557188 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zzmnj\"" May 21 17:38:51.565166 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.565137 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x"] May 21 17:38:51.612408 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.612369 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrqwc\" (UniqueName: \"kubernetes.io/projected/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-kube-api-access-zrqwc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.612408 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.612415 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.612629 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.612435 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.713811 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.713774 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrqwc\" (UniqueName: \"kubernetes.io/projected/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-kube-api-access-zrqwc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.713994 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.713845 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.713994 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.713875 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.714234 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.714215 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.714272 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.714261 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.721802 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.721771 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrqwc\" (UniqueName: \"kubernetes.io/projected/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-kube-api-access-zrqwc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.861728 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.861637 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:38:51.987470 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.987438 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x"] May 21 17:38:51.990789 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:38:51.990765 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d03010f_2ba9_4bf7_86a2_ce9203cc299c.slice/crio-49af4fac292bd44bf9cd3f8af87c488e970a6491a478fec92485b707a5850af1 WatchSource:0}: Error finding container 49af4fac292bd44bf9cd3f8af87c488e970a6491a478fec92485b707a5850af1: Status 404 returned error can't find the container with id 49af4fac292bd44bf9cd3f8af87c488e970a6491a478fec92485b707a5850af1 May 21 17:38:51.992545 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:51.992524 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:38:52.214270 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:52.214231 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" event={"ID":"8d03010f-2ba9-4bf7-86a2-ce9203cc299c","Type":"ContainerStarted","Data":"49af4fac292bd44bf9cd3f8af87c488e970a6491a478fec92485b707a5850af1"} May 21 17:38:59.235317 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:59.235282 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerID="ccf21f8fec93e92a4f8ce35879595c15018ca659d14eb5a0b89d114e1ba9e9f6" exitCode=0 May 21 17:38:59.235710 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:38:59.235346 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" event={"ID":"8d03010f-2ba9-4bf7-86a2-ce9203cc299c","Type":"ContainerDied","Data":"ccf21f8fec93e92a4f8ce35879595c15018ca659d14eb5a0b89d114e1ba9e9f6"} May 21 17:39:00.239555 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:00.239453 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerID="277812ef9133878598b3092b78e4f56201b2ac110330da433b198f687b52b30d" exitCode=0 May 21 17:39:00.240025 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:00.239546 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" event={"ID":"8d03010f-2ba9-4bf7-86a2-ce9203cc299c","Type":"ContainerDied","Data":"277812ef9133878598b3092b78e4f56201b2ac110330da433b198f687b52b30d"} May 21 17:39:08.262097 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:08.262058 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerID="a3084871ebdfcb035c2c01c71cb26a92fc12c427fc176bf840f6f7d7d36d60a7" exitCode=0 May 21 17:39:08.262453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:08.262115 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" event={"ID":"8d03010f-2ba9-4bf7-86a2-ce9203cc299c","Type":"ContainerDied","Data":"a3084871ebdfcb035c2c01c71cb26a92fc12c427fc176bf840f6f7d7d36d60a7"} May 21 17:39:09.387211 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.387186 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:39:09.457739 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.457686 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-bundle\") pod \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " May 21 17:39:09.457739 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.457747 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-util\") pod \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " May 21 17:39:09.458017 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.457853 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrqwc\" (UniqueName: \"kubernetes.io/projected/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-kube-api-access-zrqwc\") pod \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\" (UID: \"8d03010f-2ba9-4bf7-86a2-ce9203cc299c\") " May 21 17:39:09.458459 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.458416 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-bundle" (OuterVolumeSpecName: "bundle") pod "8d03010f-2ba9-4bf7-86a2-ce9203cc299c" (UID: "8d03010f-2ba9-4bf7-86a2-ce9203cc299c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:09.460128 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.460089 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-kube-api-access-zrqwc" (OuterVolumeSpecName: "kube-api-access-zrqwc") pod "8d03010f-2ba9-4bf7-86a2-ce9203cc299c" (UID: "8d03010f-2ba9-4bf7-86a2-ce9203cc299c"). InnerVolumeSpecName "kube-api-access-zrqwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:39:09.462580 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.462539 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-util" (OuterVolumeSpecName: "util") pod "8d03010f-2ba9-4bf7-86a2-ce9203cc299c" (UID: "8d03010f-2ba9-4bf7-86a2-ce9203cc299c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:09.559071 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.558967 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrqwc\" (UniqueName: \"kubernetes.io/projected/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-kube-api-access-zrqwc\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:09.559071 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.559014 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:09.559071 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:09.559023 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d03010f-2ba9-4bf7-86a2-ce9203cc299c-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:10.269041 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:10.269002 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" event={"ID":"8d03010f-2ba9-4bf7-86a2-ce9203cc299c","Type":"ContainerDied","Data":"49af4fac292bd44bf9cd3f8af87c488e970a6491a478fec92485b707a5850af1"} May 21 17:39:10.269041 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:10.269039 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49af4fac292bd44bf9cd3f8af87c488e970a6491a478fec92485b707a5850af1" May 21 17:39:10.269248 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:10.269046 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcvj6x" May 21 17:39:18.703363 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703323 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v"] May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703545 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="util" May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703555 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="util" May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703571 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="pull" May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703577 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="pull" May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703592 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="extract" May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703600 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="extract" May 21 17:39:18.703807 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.703649 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d03010f-2ba9-4bf7-86a2-ce9203cc299c" containerName="extract" May 21 17:39:18.726105 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.726065 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v"] May 21 17:39:18.726267 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.726223 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.729059 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.729033 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 17:39:18.729512 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.729482 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 17:39:18.730237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.730215 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zzmnj\"" May 21 17:39:18.824263 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.824231 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwfr\" (UniqueName: \"kubernetes.io/projected/bb7ce504-c546-47b5-9809-a696b50d9416-kube-api-access-2qwfr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.824414 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.824276 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.824414 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.824315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.925001 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.924964 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.925167 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.925015 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.925167 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.925048 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwfr\" (UniqueName: \"kubernetes.io/projected/bb7ce504-c546-47b5-9809-a696b50d9416-kube-api-access-2qwfr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.925364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.925345 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.925400 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.925381 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:18.932633 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:18.932605 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwfr\" (UniqueName: \"kubernetes.io/projected/bb7ce504-c546-47b5-9809-a696b50d9416-kube-api-access-2qwfr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:19.037420 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:19.037321 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:19.160229 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:19.160198 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v"] May 21 17:39:19.163207 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:39:19.163183 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7ce504_c546_47b5_9809_a696b50d9416.slice/crio-b1f26cca12606b3a667370fc3be4813689a764bfd8d481005f6403c7205ff8bf WatchSource:0}: Error finding container b1f26cca12606b3a667370fc3be4813689a764bfd8d481005f6403c7205ff8bf: Status 404 returned error can't find the container with id b1f26cca12606b3a667370fc3be4813689a764bfd8d481005f6403c7205ff8bf May 21 17:39:19.293304 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:19.293239 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" event={"ID":"bb7ce504-c546-47b5-9809-a696b50d9416","Type":"ContainerStarted","Data":"f3aa998ce36c391237c3389e1bb00803657cc0ead5533cabb0f3d82ccef90cf3"} May 21 17:39:19.293304 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:19.293277 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" event={"ID":"bb7ce504-c546-47b5-9809-a696b50d9416","Type":"ContainerStarted","Data":"b1f26cca12606b3a667370fc3be4813689a764bfd8d481005f6403c7205ff8bf"} May 21 17:39:20.297216 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:20.297124 2551 generic.go:358] "Generic (PLEG): container finished" podID="bb7ce504-c546-47b5-9809-a696b50d9416" containerID="f3aa998ce36c391237c3389e1bb00803657cc0ead5533cabb0f3d82ccef90cf3" exitCode=0 May 21 17:39:20.297216 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:20.297180 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" event={"ID":"bb7ce504-c546-47b5-9809-a696b50d9416","Type":"ContainerDied","Data":"f3aa998ce36c391237c3389e1bb00803657cc0ead5533cabb0f3d82ccef90cf3"} May 21 17:39:23.307663 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:23.307627 2551 generic.go:358] "Generic (PLEG): container finished" podID="bb7ce504-c546-47b5-9809-a696b50d9416" containerID="1c06747b1e8fec396a2f1816531e99b215aec72d0c80efd0558ded4ff5ef9b5d" exitCode=0 May 21 17:39:23.308087 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:23.307691 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" event={"ID":"bb7ce504-c546-47b5-9809-a696b50d9416","Type":"ContainerDied","Data":"1c06747b1e8fec396a2f1816531e99b215aec72d0c80efd0558ded4ff5ef9b5d"} May 21 17:39:24.312792 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:24.312754 2551 generic.go:358] "Generic (PLEG): container finished" podID="bb7ce504-c546-47b5-9809-a696b50d9416" containerID="2aa764dd36d29e4f9c7bd2eb8686d98249c85ceb7d162d74ec3f4130611934cb" exitCode=0 May 21 17:39:24.313212 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:24.312862 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" event={"ID":"bb7ce504-c546-47b5-9809-a696b50d9416","Type":"ContainerDied","Data":"2aa764dd36d29e4f9c7bd2eb8686d98249c85ceb7d162d74ec3f4130611934cb"} May 21 17:39:25.439775 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.439751 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:25.573900 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.573783 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-bundle\") pod \"bb7ce504-c546-47b5-9809-a696b50d9416\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " May 21 17:39:25.573900 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.573847 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qwfr\" (UniqueName: \"kubernetes.io/projected/bb7ce504-c546-47b5-9809-a696b50d9416-kube-api-access-2qwfr\") pod \"bb7ce504-c546-47b5-9809-a696b50d9416\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " May 21 17:39:25.574121 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.573876 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-util\") pod \"bb7ce504-c546-47b5-9809-a696b50d9416\" (UID: \"bb7ce504-c546-47b5-9809-a696b50d9416\") " May 21 17:39:25.578844 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.574554 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-bundle" (OuterVolumeSpecName: "bundle") pod "bb7ce504-c546-47b5-9809-a696b50d9416" (UID: "bb7ce504-c546-47b5-9809-a696b50d9416"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:25.578844 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.574854 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:25.580082 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.580029 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7ce504-c546-47b5-9809-a696b50d9416-kube-api-access-2qwfr" (OuterVolumeSpecName: "kube-api-access-2qwfr") pod "bb7ce504-c546-47b5-9809-a696b50d9416" (UID: "bb7ce504-c546-47b5-9809-a696b50d9416"). InnerVolumeSpecName "kube-api-access-2qwfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:39:25.580718 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.580694 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-util" (OuterVolumeSpecName: "util") pod "bb7ce504-c546-47b5-9809-a696b50d9416" (UID: "bb7ce504-c546-47b5-9809-a696b50d9416"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:25.675766 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.675723 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qwfr\" (UniqueName: \"kubernetes.io/projected/bb7ce504-c546-47b5-9809-a696b50d9416-kube-api-access-2qwfr\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:25.675766 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:25.675763 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7ce504-c546-47b5-9809-a696b50d9416-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:26.319649 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:26.319616 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" event={"ID":"bb7ce504-c546-47b5-9809-a696b50d9416","Type":"ContainerDied","Data":"b1f26cca12606b3a667370fc3be4813689a764bfd8d481005f6403c7205ff8bf"} May 21 17:39:26.319649 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:26.319650 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1f26cca12606b3a667370fc3be4813689a764bfd8d481005f6403c7205ff8bf" May 21 17:39:26.319881 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:26.319690 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxp7v" May 21 17:39:35.541857 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.541804 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67"] May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542039 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="util" May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542048 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="util" May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542058 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="extract" May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542064 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="extract" May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542079 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="pull" May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542084 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="pull" May 21 17:39:35.542244 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.542127 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb7ce504-c546-47b5-9809-a696b50d9416" containerName="extract" May 21 17:39:35.544624 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.544605 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.547270 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.547247 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 17:39:35.548252 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.548230 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 17:39:35.548346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.548243 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bz95b\"" May 21 17:39:35.553707 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.553681 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67"] May 21 17:39:35.645894 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.645851 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73667a64-2815-4e1a-baac-e7623c54a601-tmp\") pod \"openshift-lws-operator-bfc7f696d-z5r67\" (UID: \"73667a64-2815-4e1a-baac-e7623c54a601\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.646089 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.645929 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbzlm\" (UniqueName: \"kubernetes.io/projected/73667a64-2815-4e1a-baac-e7623c54a601-kube-api-access-fbzlm\") pod \"openshift-lws-operator-bfc7f696d-z5r67\" (UID: \"73667a64-2815-4e1a-baac-e7623c54a601\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.746462 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.746423 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbzlm\" (UniqueName: \"kubernetes.io/projected/73667a64-2815-4e1a-baac-e7623c54a601-kube-api-access-fbzlm\") pod \"openshift-lws-operator-bfc7f696d-z5r67\" (UID: \"73667a64-2815-4e1a-baac-e7623c54a601\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.746641 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.746496 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73667a64-2815-4e1a-baac-e7623c54a601-tmp\") pod \"openshift-lws-operator-bfc7f696d-z5r67\" (UID: \"73667a64-2815-4e1a-baac-e7623c54a601\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.746942 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.746925 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73667a64-2815-4e1a-baac-e7623c54a601-tmp\") pod \"openshift-lws-operator-bfc7f696d-z5r67\" (UID: \"73667a64-2815-4e1a-baac-e7623c54a601\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.755202 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.755171 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbzlm\" (UniqueName: \"kubernetes.io/projected/73667a64-2815-4e1a-baac-e7623c54a601-kube-api-access-fbzlm\") pod \"openshift-lws-operator-bfc7f696d-z5r67\" (UID: \"73667a64-2815-4e1a-baac-e7623c54a601\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.853884 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.853776 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" May 21 17:39:35.981954 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:35.981927 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67"] May 21 17:39:35.984095 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:39:35.984065 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73667a64_2815_4e1a_baac_e7623c54a601.slice/crio-176b022febc21c75bc6b65fedb47333a4bd69b575544ecf934fb0a3b3443e5ad WatchSource:0}: Error finding container 176b022febc21c75bc6b65fedb47333a4bd69b575544ecf934fb0a3b3443e5ad: Status 404 returned error can't find the container with id 176b022febc21c75bc6b65fedb47333a4bd69b575544ecf934fb0a3b3443e5ad May 21 17:39:36.348177 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:36.348139 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" event={"ID":"73667a64-2815-4e1a-baac-e7623c54a601","Type":"ContainerStarted","Data":"176b022febc21c75bc6b65fedb47333a4bd69b575544ecf934fb0a3b3443e5ad"} May 21 17:39:40.360311 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:40.360271 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" event={"ID":"73667a64-2815-4e1a-baac-e7623c54a601","Type":"ContainerStarted","Data":"363bfb246490c6035d9644dd9708e1f38704efa503a1db7abead1e18d90d4fc3"} May 21 17:39:40.380083 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:40.380031 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z5r67" podStartSLOduration=1.91483139 podStartE2EDuration="5.380015433s" podCreationTimestamp="2026-05-21 17:39:35 +0000 UTC" firstStartedPulling="2026-05-21 17:39:35.985526063 +0000 UTC m=+427.418429745" lastFinishedPulling="2026-05-21 17:39:39.450710106 +0000 UTC m=+430.883613788" observedRunningTime="2026-05-21 17:39:40.378488368 +0000 UTC m=+431.811392069" watchObservedRunningTime="2026-05-21 17:39:40.380015433 +0000 UTC m=+431.812919204" May 21 17:39:44.726580 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.726536 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668"] May 21 17:39:44.728976 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.728953 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.731445 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.731417 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 17:39:44.732245 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.732228 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 17:39:44.732322 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.732237 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zzmnj\"" May 21 17:39:44.736182 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.736146 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668"] May 21 17:39:44.814571 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.814535 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.814571 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.814571 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.814772 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.814597 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njv49\" (UniqueName: \"kubernetes.io/projected/4b80c938-7301-449f-b171-46e8c43a1436-kube-api-access-njv49\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.915202 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.915168 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.915202 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.915205 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.915460 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.915233 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njv49\" (UniqueName: \"kubernetes.io/projected/4b80c938-7301-449f-b171-46e8c43a1436-kube-api-access-njv49\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.915598 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.915573 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.915658 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.915599 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:44.926794 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:44.926760 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njv49\" (UniqueName: \"kubernetes.io/projected/4b80c938-7301-449f-b171-46e8c43a1436-kube-api-access-njv49\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:45.038583 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:45.038493 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:45.166479 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:45.166446 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668"] May 21 17:39:45.170683 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:39:45.170653 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b80c938_7301_449f_b171_46e8c43a1436.slice/crio-4a6aa0ed4efe298d2c9676eb7463d12b8542b5b0d5bb17f7d76e6256b65f9e98 WatchSource:0}: Error finding container 4a6aa0ed4efe298d2c9676eb7463d12b8542b5b0d5bb17f7d76e6256b65f9e98: Status 404 returned error can't find the container with id 4a6aa0ed4efe298d2c9676eb7463d12b8542b5b0d5bb17f7d76e6256b65f9e98 May 21 17:39:45.373874 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:45.373772 2551 generic.go:358] "Generic (PLEG): container finished" podID="4b80c938-7301-449f-b171-46e8c43a1436" containerID="676210e9e30c4a0cbca3148e6a610e577a534b1a81b13bc4a9ee1df6f5036ff3" exitCode=0 May 21 17:39:45.373874 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:45.373850 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" event={"ID":"4b80c938-7301-449f-b171-46e8c43a1436","Type":"ContainerDied","Data":"676210e9e30c4a0cbca3148e6a610e577a534b1a81b13bc4a9ee1df6f5036ff3"} May 21 17:39:45.374143 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:45.373888 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" event={"ID":"4b80c938-7301-449f-b171-46e8c43a1436","Type":"ContainerStarted","Data":"4a6aa0ed4efe298d2c9676eb7463d12b8542b5b0d5bb17f7d76e6256b65f9e98"} May 21 17:39:46.378221 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:46.378131 2551 generic.go:358] "Generic (PLEG): container finished" podID="4b80c938-7301-449f-b171-46e8c43a1436" containerID="430bf84c01ded3db73fa09569d959b8652416e89e19e48ca10f50212d363e2ce" exitCode=0 May 21 17:39:46.378221 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:46.378201 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" event={"ID":"4b80c938-7301-449f-b171-46e8c43a1436","Type":"ContainerDied","Data":"430bf84c01ded3db73fa09569d959b8652416e89e19e48ca10f50212d363e2ce"} May 21 17:39:47.386672 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:47.386636 2551 generic.go:358] "Generic (PLEG): container finished" podID="4b80c938-7301-449f-b171-46e8c43a1436" containerID="2cdf09c61b921ebac5d9454ae6f477c9ae87521c791358678a3b8e5e3bcc745c" exitCode=0 May 21 17:39:47.386672 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:47.386678 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" event={"ID":"4b80c938-7301-449f-b171-46e8c43a1436","Type":"ContainerDied","Data":"2cdf09c61b921ebac5d9454ae6f477c9ae87521c791358678a3b8e5e3bcc745c"} May 21 17:39:48.514946 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.514922 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:48.539751 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.539707 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-bundle\") pod \"4b80c938-7301-449f-b171-46e8c43a1436\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " May 21 17:39:48.539946 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.539776 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njv49\" (UniqueName: \"kubernetes.io/projected/4b80c938-7301-449f-b171-46e8c43a1436-kube-api-access-njv49\") pod \"4b80c938-7301-449f-b171-46e8c43a1436\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " May 21 17:39:48.539946 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.539810 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-util\") pod \"4b80c938-7301-449f-b171-46e8c43a1436\" (UID: \"4b80c938-7301-449f-b171-46e8c43a1436\") " May 21 17:39:48.540472 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.540443 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-bundle" (OuterVolumeSpecName: "bundle") pod "4b80c938-7301-449f-b171-46e8c43a1436" (UID: "4b80c938-7301-449f-b171-46e8c43a1436"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:48.542060 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.542027 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b80c938-7301-449f-b171-46e8c43a1436-kube-api-access-njv49" (OuterVolumeSpecName: "kube-api-access-njv49") pod "4b80c938-7301-449f-b171-46e8c43a1436" (UID: "4b80c938-7301-449f-b171-46e8c43a1436"). InnerVolumeSpecName "kube-api-access-njv49". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:39:48.548548 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.548518 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-util" (OuterVolumeSpecName: "util") pod "4b80c938-7301-449f-b171-46e8c43a1436" (UID: "4b80c938-7301-449f-b171-46e8c43a1436"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:48.641139 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.641051 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:48.641139 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.641082 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njv49\" (UniqueName: \"kubernetes.io/projected/4b80c938-7301-449f-b171-46e8c43a1436-kube-api-access-njv49\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:48.641139 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:48.641096 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b80c938-7301-449f-b171-46e8c43a1436-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:49.394457 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:49.394369 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" event={"ID":"4b80c938-7301-449f-b171-46e8c43a1436","Type":"ContainerDied","Data":"4a6aa0ed4efe298d2c9676eb7463d12b8542b5b0d5bb17f7d76e6256b65f9e98"} May 21 17:39:49.394457 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:49.394402 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a6aa0ed4efe298d2c9676eb7463d12b8542b5b0d5bb17f7d76e6256b65f9e98" May 21 17:39:49.394457 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:49.394421 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5kr668" May 21 17:39:53.734025 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.733985 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw"] May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734213 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="util" May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734223 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="util" May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734231 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="pull" May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734236 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="pull" May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734251 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="extract" May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734257 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="extract" May 21 17:39:53.734535 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.734295 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b80c938-7301-449f-b171-46e8c43a1436" containerName="extract" May 21 17:39:53.736942 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.736923 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.739200 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.739175 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 17:39:53.739318 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.739174 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zzmnj\"" May 21 17:39:53.740186 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.740172 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 17:39:53.744160 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.744137 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw"] May 21 17:39:53.777839 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.777788 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.778035 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.777885 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.778035 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.777928 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjnnt\" (UniqueName: \"kubernetes.io/projected/d702b77d-dfc0-490c-93c1-34aa61dd8f30-kube-api-access-qjnnt\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.878508 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.878471 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.878690 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.878520 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjnnt\" (UniqueName: \"kubernetes.io/projected/d702b77d-dfc0-490c-93c1-34aa61dd8f30-kube-api-access-qjnnt\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.878690 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.878555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.878983 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.878960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.879061 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.878978 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:53.889866 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:53.889835 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjnnt\" (UniqueName: \"kubernetes.io/projected/d702b77d-dfc0-490c-93c1-34aa61dd8f30-kube-api-access-qjnnt\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:54.047095 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:54.046985 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:54.172902 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:54.172864 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw"] May 21 17:39:54.175590 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:39:54.175556 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd702b77d_dfc0_490c_93c1_34aa61dd8f30.slice/crio-acde2876e3085258d40e85823970b8ab88034255321a00f98dc40dafc90c1419 WatchSource:0}: Error finding container acde2876e3085258d40e85823970b8ab88034255321a00f98dc40dafc90c1419: Status 404 returned error can't find the container with id acde2876e3085258d40e85823970b8ab88034255321a00f98dc40dafc90c1419 May 21 17:39:54.413502 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:54.413468 2551 generic.go:358] "Generic (PLEG): container finished" podID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerID="77b2cbdd7142911af02eae0e1750a105c8d41c10d38ca05257c4ef34687fff94" exitCode=0 May 21 17:39:54.413670 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:54.413510 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" event={"ID":"d702b77d-dfc0-490c-93c1-34aa61dd8f30","Type":"ContainerDied","Data":"77b2cbdd7142911af02eae0e1750a105c8d41c10d38ca05257c4ef34687fff94"} May 21 17:39:54.413670 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:54.413544 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" event={"ID":"d702b77d-dfc0-490c-93c1-34aa61dd8f30","Type":"ContainerStarted","Data":"acde2876e3085258d40e85823970b8ab88034255321a00f98dc40dafc90c1419"} May 21 17:39:55.417766 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.417730 2551 generic.go:358] "Generic (PLEG): container finished" podID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerID="8df646f829f591d8d007accdbc8c9929725f385e7707e6b2af13773115d1e61f" exitCode=0 May 21 17:39:55.418181 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.417809 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" event={"ID":"d702b77d-dfc0-490c-93c1-34aa61dd8f30","Type":"ContainerDied","Data":"8df646f829f591d8d007accdbc8c9929725f385e7707e6b2af13773115d1e61f"} May 21 17:39:55.557123 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.557083 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7"] May 21 17:39:55.559430 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.559407 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.561917 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.561874 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 17:39:55.562061 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.561934 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-flk4z\"" May 21 17:39:55.562061 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.562026 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 17:39:55.562170 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.562100 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 17:39:55.562840 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.562802 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 17:39:55.574384 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.574353 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7"] May 21 17:39:55.592990 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.592955 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftlm4\" (UniqueName: \"kubernetes.io/projected/f5f27544-8fcc-4c7a-8d5f-a584244ab638-kube-api-access-ftlm4\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.593145 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.593013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5f27544-8fcc-4c7a-8d5f-a584244ab638-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.593145 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.593083 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5f27544-8fcc-4c7a-8d5f-a584244ab638-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.694387 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.694286 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftlm4\" (UniqueName: \"kubernetes.io/projected/f5f27544-8fcc-4c7a-8d5f-a584244ab638-kube-api-access-ftlm4\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.694387 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.694340 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5f27544-8fcc-4c7a-8d5f-a584244ab638-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.694387 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.694368 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5f27544-8fcc-4c7a-8d5f-a584244ab638-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.696956 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.696925 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5f27544-8fcc-4c7a-8d5f-a584244ab638-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.696956 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.696943 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5f27544-8fcc-4c7a-8d5f-a584244ab638-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.702810 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.702783 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftlm4\" (UniqueName: \"kubernetes.io/projected/f5f27544-8fcc-4c7a-8d5f-a584244ab638-kube-api-access-ftlm4\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7\" (UID: \"f5f27544-8fcc-4c7a-8d5f-a584244ab638\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:55.924417 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:55.924374 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:56.059036 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:56.058863 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7"] May 21 17:39:56.061910 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:39:56.061809 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f27544_8fcc_4c7a_8d5f_a584244ab638.slice/crio-b51cc18eaf71a70f9b38ecaccd926ee43e2709c2c178384ccaed5b8040698f2f WatchSource:0}: Error finding container b51cc18eaf71a70f9b38ecaccd926ee43e2709c2c178384ccaed5b8040698f2f: Status 404 returned error can't find the container with id b51cc18eaf71a70f9b38ecaccd926ee43e2709c2c178384ccaed5b8040698f2f May 21 17:39:56.421957 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:56.421915 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" event={"ID":"f5f27544-8fcc-4c7a-8d5f-a584244ab638","Type":"ContainerStarted","Data":"b51cc18eaf71a70f9b38ecaccd926ee43e2709c2c178384ccaed5b8040698f2f"} May 21 17:39:56.423924 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:56.423894 2551 generic.go:358] "Generic (PLEG): container finished" podID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerID="fc339403f9d8ee53b204accfa0bfcb4876a4be4cd51e068c26b78c0492a57442" exitCode=0 May 21 17:39:56.424034 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:56.423941 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" event={"ID":"d702b77d-dfc0-490c-93c1-34aa61dd8f30","Type":"ContainerDied","Data":"fc339403f9d8ee53b204accfa0bfcb4876a4be4cd51e068c26b78c0492a57442"} May 21 17:39:58.446409 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.446382 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:58.517806 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.517776 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjnnt\" (UniqueName: \"kubernetes.io/projected/d702b77d-dfc0-490c-93c1-34aa61dd8f30-kube-api-access-qjnnt\") pod \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " May 21 17:39:58.517949 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.517867 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-bundle\") pod \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " May 21 17:39:58.517949 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.517909 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-util\") pod \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\" (UID: \"d702b77d-dfc0-490c-93c1-34aa61dd8f30\") " May 21 17:39:58.518626 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.518594 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-bundle" (OuterVolumeSpecName: "bundle") pod "d702b77d-dfc0-490c-93c1-34aa61dd8f30" (UID: "d702b77d-dfc0-490c-93c1-34aa61dd8f30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:58.520471 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.520443 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d702b77d-dfc0-490c-93c1-34aa61dd8f30-kube-api-access-qjnnt" (OuterVolumeSpecName: "kube-api-access-qjnnt") pod "d702b77d-dfc0-490c-93c1-34aa61dd8f30" (UID: "d702b77d-dfc0-490c-93c1-34aa61dd8f30"). InnerVolumeSpecName "kube-api-access-qjnnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:39:58.524233 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.524202 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-util" (OuterVolumeSpecName: "util") pod "d702b77d-dfc0-490c-93c1-34aa61dd8f30" (UID: "d702b77d-dfc0-490c-93c1-34aa61dd8f30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:39:58.619152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.619113 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjnnt\" (UniqueName: \"kubernetes.io/projected/d702b77d-dfc0-490c-93c1-34aa61dd8f30-kube-api-access-qjnnt\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:58.619152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.619146 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:58.619152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:58.619155 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d702b77d-dfc0-490c-93c1-34aa61dd8f30-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:39:59.435868 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:59.435764 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" event={"ID":"f5f27544-8fcc-4c7a-8d5f-a584244ab638","Type":"ContainerStarted","Data":"ca06d46891e4a9bce3231792bca97f10a6d00a8bf72f9c2fd4d1fdf0bcd75ac8"} May 21 17:39:59.436047 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:59.435875 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:39:59.437485 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:59.437462 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" May 21 17:39:59.437607 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:59.437462 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9cwmlw" event={"ID":"d702b77d-dfc0-490c-93c1-34aa61dd8f30","Type":"ContainerDied","Data":"acde2876e3085258d40e85823970b8ab88034255321a00f98dc40dafc90c1419"} May 21 17:39:59.437607 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:59.437564 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acde2876e3085258d40e85823970b8ab88034255321a00f98dc40dafc90c1419" May 21 17:39:59.453653 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:39:59.453595 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" podStartSLOduration=2.036441583 podStartE2EDuration="4.453577557s" podCreationTimestamp="2026-05-21 17:39:55 +0000 UTC" firstStartedPulling="2026-05-21 17:39:56.063595779 +0000 UTC m=+447.496499462" lastFinishedPulling="2026-05-21 17:39:58.480731744 +0000 UTC m=+449.913635436" observedRunningTime="2026-05-21 17:39:59.45267618 +0000 UTC m=+450.885579881" watchObservedRunningTime="2026-05-21 17:39:59.453577557 +0000 UTC m=+450.886481279" May 21 17:40:10.443442 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:10.443409 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7" May 21 17:40:12.804399 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804364 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv"] May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804704 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="extract" May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804720 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="extract" May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804735 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="pull" May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804742 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="pull" May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804754 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="util" May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804762 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="util" May 21 17:40:12.804891 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.804860 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="d702b77d-dfc0-490c-93c1-34aa61dd8f30" containerName="extract" May 21 17:40:12.810675 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.810649 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:12.813258 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.813236 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 17:40:12.813372 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.813240 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 17:40:12.814274 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.814251 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zzmnj\"" May 21 17:40:12.816467 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.816447 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv"] May 21 17:40:12.918598 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.918563 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:12.918748 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.918612 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrbdg\" (UniqueName: \"kubernetes.io/projected/bcda8c82-ab65-4619-b0bf-014e330100d8-kube-api-access-nrbdg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:12.918748 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:12.918721 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.019892 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.019848 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrbdg\" (UniqueName: \"kubernetes.io/projected/bcda8c82-ab65-4619-b0bf-014e330100d8-kube-api-access-nrbdg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.020078 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.019919 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.020078 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.019947 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.020409 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.020388 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.020448 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.020399 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.028203 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.028168 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrbdg\" (UniqueName: \"kubernetes.io/projected/bcda8c82-ab65-4619-b0bf-014e330100d8-kube-api-access-nrbdg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.033481 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.033456 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf"] May 21 17:40:13.037731 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.037712 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.040076 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.040027 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 17:40:13.040187 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.040051 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 17:40:13.040187 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.040099 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xt6ww\"" May 21 17:40:13.040338 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.040324 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 17:40:13.040403 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.040379 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 17:40:13.047021 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.046999 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf"] May 21 17:40:13.121035 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.120941 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:13.121194 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.121095 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c37d5109-2f68-4b4f-83c9-a27652f2bfca-tmp\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.121194 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.121131 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvf6d\" (UniqueName: \"kubernetes.io/projected/c37d5109-2f68-4b4f-83c9-a27652f2bfca-kube-api-access-fvf6d\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.121282 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.121207 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c37d5109-2f68-4b4f-83c9-a27652f2bfca-tls-certs\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.222121 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.222090 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c37d5109-2f68-4b4f-83c9-a27652f2bfca-tls-certs\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.222121 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.222133 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c37d5109-2f68-4b4f-83c9-a27652f2bfca-tmp\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.222330 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.222162 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvf6d\" (UniqueName: \"kubernetes.io/projected/c37d5109-2f68-4b4f-83c9-a27652f2bfca-kube-api-access-fvf6d\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.224520 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.224493 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c37d5109-2f68-4b4f-83c9-a27652f2bfca-tmp\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.224662 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.224609 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c37d5109-2f68-4b4f-83c9-a27652f2bfca-tls-certs\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.230282 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.230253 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvf6d\" (UniqueName: \"kubernetes.io/projected/c37d5109-2f68-4b4f-83c9-a27652f2bfca-kube-api-access-fvf6d\") pod \"kube-auth-proxy-85f6f977d9-dw4qf\" (UID: \"c37d5109-2f68-4b4f-83c9-a27652f2bfca\") " pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.253252 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.253131 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv"] May 21 17:40:13.255883 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:13.255858 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcda8c82_ab65_4619_b0bf_014e330100d8.slice/crio-8288a6eb8c930295e00b30a2d30f0f992cb47f6cdcea08d1d36b4b9b36ce0fea WatchSource:0}: Error finding container 8288a6eb8c930295e00b30a2d30f0f992cb47f6cdcea08d1d36b4b9b36ce0fea: Status 404 returned error can't find the container with id 8288a6eb8c930295e00b30a2d30f0f992cb47f6cdcea08d1d36b4b9b36ce0fea May 21 17:40:13.347744 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.347705 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" May 21 17:40:13.472142 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.472107 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf"] May 21 17:40:13.474908 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:13.474877 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37d5109_2f68_4b4f_83c9_a27652f2bfca.slice/crio-261ee35c1644f64ccfb5186aefe6c79645fed77d9a37ac503fcd70ad417fae84 WatchSource:0}: Error finding container 261ee35c1644f64ccfb5186aefe6c79645fed77d9a37ac503fcd70ad417fae84: Status 404 returned error can't find the container with id 261ee35c1644f64ccfb5186aefe6c79645fed77d9a37ac503fcd70ad417fae84 May 21 17:40:13.482122 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.482092 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" event={"ID":"c37d5109-2f68-4b4f-83c9-a27652f2bfca","Type":"ContainerStarted","Data":"261ee35c1644f64ccfb5186aefe6c79645fed77d9a37ac503fcd70ad417fae84"} May 21 17:40:13.483377 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.483356 2551 generic.go:358] "Generic (PLEG): container finished" podID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerID="7437eb10f7588d1cf1e2338e1daccb9928fa236cb3899647abefd3eaf0f7a248" exitCode=0 May 21 17:40:13.483458 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.483392 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" event={"ID":"bcda8c82-ab65-4619-b0bf-014e330100d8","Type":"ContainerDied","Data":"7437eb10f7588d1cf1e2338e1daccb9928fa236cb3899647abefd3eaf0f7a248"} May 21 17:40:13.483458 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:13.483417 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" event={"ID":"bcda8c82-ab65-4619-b0bf-014e330100d8","Type":"ContainerStarted","Data":"8288a6eb8c930295e00b30a2d30f0f992cb47f6cdcea08d1d36b4b9b36ce0fea"} May 21 17:40:15.498628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:15.498589 2551 generic.go:358] "Generic (PLEG): container finished" podID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerID="501ec83965492d5086ae20e5790bec862339ffb874cdd873a63ec0e6a06fdd29" exitCode=0 May 21 17:40:15.499081 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:15.498682 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" event={"ID":"bcda8c82-ab65-4619-b0bf-014e330100d8","Type":"ContainerDied","Data":"501ec83965492d5086ae20e5790bec862339ffb874cdd873a63ec0e6a06fdd29"} May 21 17:40:16.397758 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.397719 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-kllqn"] May 21 17:40:16.400968 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.400949 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:16.403253 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.403216 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 17:40:16.403423 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.403403 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9pxxl\"" May 21 17:40:16.408659 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.408634 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-kllqn"] May 21 17:40:16.450235 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.450190 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:16.450235 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.450240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28nkk\" (UniqueName: \"kubernetes.io/projected/be876397-6267-4bbb-87c8-13d7fa9e4a94-kube-api-access-28nkk\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:16.505519 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.505432 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" event={"ID":"c37d5109-2f68-4b4f-83c9-a27652f2bfca","Type":"ContainerStarted","Data":"1a82b2bdf8d4a0c54cfeff717d54be12acd7d9d669374d77a4075ece8c8713e0"} May 21 17:40:16.507282 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.507257 2551 generic.go:358] "Generic (PLEG): container finished" podID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerID="bec2267be78f7a72cd8daecabeb37973e76b4cb9aba081efa2eeb27a2801779a" exitCode=0 May 21 17:40:16.507399 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.507336 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" event={"ID":"bcda8c82-ab65-4619-b0bf-014e330100d8","Type":"ContainerDied","Data":"bec2267be78f7a72cd8daecabeb37973e76b4cb9aba081efa2eeb27a2801779a"} May 21 17:40:16.521209 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.521155 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85f6f977d9-dw4qf" podStartSLOduration=0.697316769 podStartE2EDuration="3.521140162s" podCreationTimestamp="2026-05-21 17:40:13 +0000 UTC" firstStartedPulling="2026-05-21 17:40:13.47676292 +0000 UTC m=+464.909666600" lastFinishedPulling="2026-05-21 17:40:16.300586314 +0000 UTC m=+467.733489993" observedRunningTime="2026-05-21 17:40:16.519859467 +0000 UTC m=+467.952763165" watchObservedRunningTime="2026-05-21 17:40:16.521140162 +0000 UTC m=+467.954043862" May 21 17:40:16.551569 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.551522 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:16.551735 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:40:16.551640 2551 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 17:40:16.551735 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.551679 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28nkk\" (UniqueName: \"kubernetes.io/projected/be876397-6267-4bbb-87c8-13d7fa9e4a94-kube-api-access-28nkk\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:16.551735 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:40:16.551691 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert podName:be876397-6267-4bbb-87c8-13d7fa9e4a94 nodeName:}" failed. No retries permitted until 2026-05-21 17:40:17.051673581 +0000 UTC m=+468.484577265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert") pod "odh-model-controller-858dbf95b8-kllqn" (UID: "be876397-6267-4bbb-87c8-13d7fa9e4a94") : secret "odh-model-controller-webhook-cert" not found May 21 17:40:16.561727 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:16.561690 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28nkk\" (UniqueName: \"kubernetes.io/projected/be876397-6267-4bbb-87c8-13d7fa9e4a94-kube-api-access-28nkk\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:17.056640 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.056599 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:17.056844 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:40:17.056751 2551 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 17:40:17.056844 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:40:17.056840 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert podName:be876397-6267-4bbb-87c8-13d7fa9e4a94 nodeName:}" failed. No retries permitted until 2026-05-21 17:40:18.056801967 +0000 UTC m=+469.489705646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert") pod "odh-model-controller-858dbf95b8-kllqn" (UID: "be876397-6267-4bbb-87c8-13d7fa9e4a94") : secret "odh-model-controller-webhook-cert" not found May 21 17:40:17.634183 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.634160 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:17.761252 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.761157 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrbdg\" (UniqueName: \"kubernetes.io/projected/bcda8c82-ab65-4619-b0bf-014e330100d8-kube-api-access-nrbdg\") pod \"bcda8c82-ab65-4619-b0bf-014e330100d8\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " May 21 17:40:17.761252 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.761203 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-util\") pod \"bcda8c82-ab65-4619-b0bf-014e330100d8\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " May 21 17:40:17.761252 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.761235 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-bundle\") pod \"bcda8c82-ab65-4619-b0bf-014e330100d8\" (UID: \"bcda8c82-ab65-4619-b0bf-014e330100d8\") " May 21 17:40:17.762190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.762163 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-bundle" (OuterVolumeSpecName: "bundle") pod "bcda8c82-ab65-4619-b0bf-014e330100d8" (UID: "bcda8c82-ab65-4619-b0bf-014e330100d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:40:17.763543 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.763518 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcda8c82-ab65-4619-b0bf-014e330100d8-kube-api-access-nrbdg" (OuterVolumeSpecName: "kube-api-access-nrbdg") pod "bcda8c82-ab65-4619-b0bf-014e330100d8" (UID: "bcda8c82-ab65-4619-b0bf-014e330100d8"). InnerVolumeSpecName "kube-api-access-nrbdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:40:17.769418 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.769372 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-util" (OuterVolumeSpecName: "util") pod "bcda8c82-ab65-4619-b0bf-014e330100d8" (UID: "bcda8c82-ab65-4619-b0bf-014e330100d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:40:17.862738 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.862686 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrbdg\" (UniqueName: \"kubernetes.io/projected/bcda8c82-ab65-4619-b0bf-014e330100d8-kube-api-access-nrbdg\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:40:17.862738 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.862732 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:40:17.862738 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:17.862744 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda8c82-ab65-4619-b0bf-014e330100d8-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:40:18.064787 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.064691 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:18.067248 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.067214 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be876397-6267-4bbb-87c8-13d7fa9e4a94-cert\") pod \"odh-model-controller-858dbf95b8-kllqn\" (UID: \"be876397-6267-4bbb-87c8-13d7fa9e4a94\") " pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:18.211971 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.211925 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:18.339071 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.339039 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-kllqn"] May 21 17:40:18.342383 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:18.342355 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe876397_6267_4bbb_87c8_13d7fa9e4a94.slice/crio-c79cdc4214026a2365cc6fe2a3a755ef68ce7ab7d8d686482cc16ca17644e7b7 WatchSource:0}: Error finding container c79cdc4214026a2365cc6fe2a3a755ef68ce7ab7d8d686482cc16ca17644e7b7: Status 404 returned error can't find the container with id c79cdc4214026a2365cc6fe2a3a755ef68ce7ab7d8d686482cc16ca17644e7b7 May 21 17:40:18.514619 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.514587 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" event={"ID":"be876397-6267-4bbb-87c8-13d7fa9e4a94","Type":"ContainerStarted","Data":"c79cdc4214026a2365cc6fe2a3a755ef68ce7ab7d8d686482cc16ca17644e7b7"} May 21 17:40:18.516193 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.516163 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" event={"ID":"bcda8c82-ab65-4619-b0bf-014e330100d8","Type":"ContainerDied","Data":"8288a6eb8c930295e00b30a2d30f0f992cb47f6cdcea08d1d36b4b9b36ce0fea"} May 21 17:40:18.516193 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.516188 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8288a6eb8c930295e00b30a2d30f0f992cb47f6cdcea08d1d36b4b9b36ce0fea" May 21 17:40:18.516315 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:18.516225 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pprzv" May 21 17:40:21.529696 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.529660 2551 generic.go:358] "Generic (PLEG): container finished" podID="be876397-6267-4bbb-87c8-13d7fa9e4a94" containerID="3862479cba5da43470cd1d868c61c6440481db6f8e942c2a58fae456ae8327f8" exitCode=1 May 21 17:40:21.530106 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.529741 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" event={"ID":"be876397-6267-4bbb-87c8-13d7fa9e4a94","Type":"ContainerDied","Data":"3862479cba5da43470cd1d868c61c6440481db6f8e942c2a58fae456ae8327f8"} May 21 17:40:21.530106 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.529957 2551 scope.go:117] "RemoveContainer" containerID="3862479cba5da43470cd1d868c61c6440481db6f8e942c2a58fae456ae8327f8" May 21 17:40:21.747785 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.747746 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-zzknx"] May 21 17:40:21.748026 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748014 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="util" May 21 17:40:21.748065 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748036 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="util" May 21 17:40:21.748065 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748049 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="pull" May 21 17:40:21.748065 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748054 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="pull" May 21 17:40:21.748065 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748064 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="extract" May 21 17:40:21.748201 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748070 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="extract" May 21 17:40:21.748201 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.748116 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcda8c82-ab65-4619-b0bf-014e330100d8" containerName="extract" May 21 17:40:21.750947 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.750927 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:21.753159 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.753131 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 17:40:21.753283 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.753211 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s9vgq\"" May 21 17:40:21.759378 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.759351 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-zzknx"] May 21 17:40:21.797970 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.797881 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wz6l\" (UniqueName: \"kubernetes.io/projected/9780793a-7a26-4b89-8e25-6e98a332d457-kube-api-access-2wz6l\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:21.797970 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.797931 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9780793a-7a26-4b89-8e25-6e98a332d457-cert\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:21.899346 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.899310 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wz6l\" (UniqueName: \"kubernetes.io/projected/9780793a-7a26-4b89-8e25-6e98a332d457-kube-api-access-2wz6l\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:21.899514 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.899360 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9780793a-7a26-4b89-8e25-6e98a332d457-cert\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:21.899514 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:40:21.899457 2551 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 17:40:21.899514 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:40:21.899511 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9780793a-7a26-4b89-8e25-6e98a332d457-cert podName:9780793a-7a26-4b89-8e25-6e98a332d457 nodeName:}" failed. No retries permitted until 2026-05-21 17:40:22.399494862 +0000 UTC m=+473.832398546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9780793a-7a26-4b89-8e25-6e98a332d457-cert") pod "kserve-controller-manager-856948b99f-zzknx" (UID: "9780793a-7a26-4b89-8e25-6e98a332d457") : secret "kserve-webhook-server-cert" not found May 21 17:40:21.907369 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:21.907309 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wz6l\" (UniqueName: \"kubernetes.io/projected/9780793a-7a26-4b89-8e25-6e98a332d457-kube-api-access-2wz6l\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:22.403419 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.403382 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9780793a-7a26-4b89-8e25-6e98a332d457-cert\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:22.405845 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.405808 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9780793a-7a26-4b89-8e25-6e98a332d457-cert\") pod \"kserve-controller-manager-856948b99f-zzknx\" (UID: \"9780793a-7a26-4b89-8e25-6e98a332d457\") " pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:22.534069 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.534035 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" event={"ID":"be876397-6267-4bbb-87c8-13d7fa9e4a94","Type":"ContainerStarted","Data":"4765f1b76b8fe42930f9fe6b59e0a488981d57ae36524b224f9c16b1b1edc44d"} May 21 17:40:22.534439 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.534153 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:22.551253 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.551203 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" podStartSLOduration=3.072924592 podStartE2EDuration="6.551189507s" podCreationTimestamp="2026-05-21 17:40:16 +0000 UTC" firstStartedPulling="2026-05-21 17:40:18.343707776 +0000 UTC m=+469.776611455" lastFinishedPulling="2026-05-21 17:40:21.821972691 +0000 UTC m=+473.254876370" observedRunningTime="2026-05-21 17:40:22.550049955 +0000 UTC m=+473.982953656" watchObservedRunningTime="2026-05-21 17:40:22.551189507 +0000 UTC m=+473.984093207" May 21 17:40:22.663027 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.662934 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:22.796176 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:22.796151 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-zzknx"] May 21 17:40:22.798095 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:22.798073 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9780793a_7a26_4b89_8e25_6e98a332d457.slice/crio-54d3a9fa83429e5a5c35cc790e157fa104409c5f07831cbe07395104c931e9c5 WatchSource:0}: Error finding container 54d3a9fa83429e5a5c35cc790e157fa104409c5f07831cbe07395104c931e9c5: Status 404 returned error can't find the container with id 54d3a9fa83429e5a5c35cc790e157fa104409c5f07831cbe07395104c931e9c5 May 21 17:40:23.538435 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:23.538400 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" event={"ID":"9780793a-7a26-4b89-8e25-6e98a332d457","Type":"ContainerStarted","Data":"54d3a9fa83429e5a5c35cc790e157fa104409c5f07831cbe07395104c931e9c5"} May 21 17:40:26.551786 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.551746 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" event={"ID":"9780793a-7a26-4b89-8e25-6e98a332d457","Type":"ContainerStarted","Data":"566faac0576dd04595eb191206572efed468ae6b810d4741446995f6225d3634"} May 21 17:40:26.552223 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.551852 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:40:26.588581 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.588525 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" podStartSLOduration=2.560352228 podStartE2EDuration="5.588509621s" podCreationTimestamp="2026-05-21 17:40:21 +0000 UTC" firstStartedPulling="2026-05-21 17:40:22.799478947 +0000 UTC m=+474.232382627" lastFinishedPulling="2026-05-21 17:40:25.827636338 +0000 UTC m=+477.260540020" observedRunningTime="2026-05-21 17:40:26.587702977 +0000 UTC m=+478.020606677" watchObservedRunningTime="2026-05-21 17:40:26.588509621 +0000 UTC m=+478.021413321" May 21 17:40:26.859119 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.859027 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l"] May 21 17:40:26.862350 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.862322 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:26.865190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.865166 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zzmnj\"" May 21 17:40:26.865314 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.865201 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 17:40:26.866339 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.866314 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 17:40:26.873441 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.873410 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l"] May 21 17:40:26.937978 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.937936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plwbs\" (UniqueName: \"kubernetes.io/projected/6d134f22-7ae5-4b1e-a5bc-033627f92f98-kube-api-access-plwbs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:26.938158 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.938007 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:26.938158 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:26.938075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.038567 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.038529 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.038567 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.038572 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.038810 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.038596 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plwbs\" (UniqueName: \"kubernetes.io/projected/6d134f22-7ae5-4b1e-a5bc-033627f92f98-kube-api-access-plwbs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.038983 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.038960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.039049 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.038994 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.052125 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.052099 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plwbs\" (UniqueName: \"kubernetes.io/projected/6d134f22-7ae5-4b1e-a5bc-033627f92f98-kube-api-access-plwbs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.171643 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.171604 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:27.299892 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.299861 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l"] May 21 17:40:27.302279 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:27.302246 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d134f22_7ae5_4b1e_a5bc_033627f92f98.slice/crio-aca12e47df64b63c5518fa1122c147fdc1e66f795928603c5ce0d3b5ee51cb2e WatchSource:0}: Error finding container aca12e47df64b63c5518fa1122c147fdc1e66f795928603c5ce0d3b5ee51cb2e: Status 404 returned error can't find the container with id aca12e47df64b63c5518fa1122c147fdc1e66f795928603c5ce0d3b5ee51cb2e May 21 17:40:27.556740 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.556659 2551 generic.go:358] "Generic (PLEG): container finished" podID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerID="ff1059b96cebac705ea85b599d1729e2360ccdf5128f224d6fd3b717e9afdad9" exitCode=0 May 21 17:40:27.557218 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.556750 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" event={"ID":"6d134f22-7ae5-4b1e-a5bc-033627f92f98","Type":"ContainerDied","Data":"ff1059b96cebac705ea85b599d1729e2360ccdf5128f224d6fd3b717e9afdad9"} May 21 17:40:27.557218 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:27.556794 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" event={"ID":"6d134f22-7ae5-4b1e-a5bc-033627f92f98","Type":"ContainerStarted","Data":"aca12e47df64b63c5518fa1122c147fdc1e66f795928603c5ce0d3b5ee51cb2e"} May 21 17:40:28.004324 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.004292 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2"] May 21 17:40:28.006557 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.006539 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.009019 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.008992 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 17:40:28.009149 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.009040 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 17:40:28.009149 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.009063 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7gghb\"" May 21 17:40:28.019120 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.019089 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2"] May 21 17:40:28.149542 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.149499 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zcr\" (UniqueName: \"kubernetes.io/projected/7fe38442-fbab-403f-938a-d1471b310ac8-kube-api-access-f5zcr\") pod \"servicemesh-operator3-55f49c5f94-j2zw2\" (UID: \"7fe38442-fbab-403f-938a-d1471b310ac8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.149714 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.149558 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7fe38442-fbab-403f-938a-d1471b310ac8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-j2zw2\" (UID: \"7fe38442-fbab-403f-938a-d1471b310ac8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.250534 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.250493 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zcr\" (UniqueName: \"kubernetes.io/projected/7fe38442-fbab-403f-938a-d1471b310ac8-kube-api-access-f5zcr\") pod \"servicemesh-operator3-55f49c5f94-j2zw2\" (UID: \"7fe38442-fbab-403f-938a-d1471b310ac8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.250728 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.250555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7fe38442-fbab-403f-938a-d1471b310ac8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-j2zw2\" (UID: \"7fe38442-fbab-403f-938a-d1471b310ac8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.253052 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.253026 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7fe38442-fbab-403f-938a-d1471b310ac8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-j2zw2\" (UID: \"7fe38442-fbab-403f-938a-d1471b310ac8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.261736 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.261674 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zcr\" (UniqueName: \"kubernetes.io/projected/7fe38442-fbab-403f-938a-d1471b310ac8-kube-api-access-f5zcr\") pod \"servicemesh-operator3-55f49c5f94-j2zw2\" (UID: \"7fe38442-fbab-403f-938a-d1471b310ac8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.317628 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.317589 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:28.463476 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.463435 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2"] May 21 17:40:28.469870 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:28.469840 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe38442_fbab_403f_938a_d1471b310ac8.slice/crio-05eeb1ea06aac4aec0c1db89bc221e3da6618fad1952fd94c0f2b28fa9922401 WatchSource:0}: Error finding container 05eeb1ea06aac4aec0c1db89bc221e3da6618fad1952fd94c0f2b28fa9922401: Status 404 returned error can't find the container with id 05eeb1ea06aac4aec0c1db89bc221e3da6618fad1952fd94c0f2b28fa9922401 May 21 17:40:28.561610 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:28.561508 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" event={"ID":"7fe38442-fbab-403f-938a-d1471b310ac8","Type":"ContainerStarted","Data":"05eeb1ea06aac4aec0c1db89bc221e3da6618fad1952fd94c0f2b28fa9922401"} May 21 17:40:30.570759 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:30.570672 2551 generic.go:358] "Generic (PLEG): container finished" podID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerID="528fde35c9d28636478a0d1954aa3a70c55397280f9f30175c4cf53cd957d79f" exitCode=0 May 21 17:40:30.571199 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:30.570759 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" event={"ID":"6d134f22-7ae5-4b1e-a5bc-033627f92f98","Type":"ContainerDied","Data":"528fde35c9d28636478a0d1954aa3a70c55397280f9f30175c4cf53cd957d79f"} May 21 17:40:31.576641 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:31.576603 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" event={"ID":"7fe38442-fbab-403f-938a-d1471b310ac8","Type":"ContainerStarted","Data":"c584f99f2b4e9c2726134196f1a065d3b54f8d457c3b0c6a9f560181f754eb8d"} May 21 17:40:31.577179 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:31.576701 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:31.578704 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:31.578676 2551 generic.go:358] "Generic (PLEG): container finished" podID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerID="03b68894f13ada83e34f918db2ea27e81f986c98c79652080d4885137676c583" exitCode=0 May 21 17:40:31.578829 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:31.578715 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" event={"ID":"6d134f22-7ae5-4b1e-a5bc-033627f92f98","Type":"ContainerDied","Data":"03b68894f13ada83e34f918db2ea27e81f986c98c79652080d4885137676c583"} May 21 17:40:31.597546 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:31.597482 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" podStartSLOduration=1.784377984 podStartE2EDuration="4.597465786s" podCreationTimestamp="2026-05-21 17:40:27 +0000 UTC" firstStartedPulling="2026-05-21 17:40:28.472689746 +0000 UTC m=+479.905593428" lastFinishedPulling="2026-05-21 17:40:31.285777543 +0000 UTC m=+482.718681230" observedRunningTime="2026-05-21 17:40:31.595899484 +0000 UTC m=+483.028803184" watchObservedRunningTime="2026-05-21 17:40:31.597465786 +0000 UTC m=+483.030369488" May 21 17:40:32.708317 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.708292 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:32.788053 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.788011 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plwbs\" (UniqueName: \"kubernetes.io/projected/6d134f22-7ae5-4b1e-a5bc-033627f92f98-kube-api-access-plwbs\") pod \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " May 21 17:40:32.788242 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.788070 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-bundle\") pod \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " May 21 17:40:32.788242 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.788097 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-util\") pod \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\" (UID: \"6d134f22-7ae5-4b1e-a5bc-033627f92f98\") " May 21 17:40:32.789267 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.789229 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-bundle" (OuterVolumeSpecName: "bundle") pod "6d134f22-7ae5-4b1e-a5bc-033627f92f98" (UID: "6d134f22-7ae5-4b1e-a5bc-033627f92f98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:40:32.790310 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.790274 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d134f22-7ae5-4b1e-a5bc-033627f92f98-kube-api-access-plwbs" (OuterVolumeSpecName: "kube-api-access-plwbs") pod "6d134f22-7ae5-4b1e-a5bc-033627f92f98" (UID: "6d134f22-7ae5-4b1e-a5bc-033627f92f98"). InnerVolumeSpecName "kube-api-access-plwbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:40:32.793040 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.792997 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-util" (OuterVolumeSpecName: "util") pod "6d134f22-7ae5-4b1e-a5bc-033627f92f98" (UID: "6d134f22-7ae5-4b1e-a5bc-033627f92f98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:40:32.889109 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.889056 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:40:32.889109 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.889112 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plwbs\" (UniqueName: \"kubernetes.io/projected/6d134f22-7ae5-4b1e-a5bc-033627f92f98-kube-api-access-plwbs\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:40:32.889299 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:32.889122 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d134f22-7ae5-4b1e-a5bc-033627f92f98-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:40:33.541182 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:33.541095 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-kllqn" May 21 17:40:33.588316 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:33.588284 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" event={"ID":"6d134f22-7ae5-4b1e-a5bc-033627f92f98","Type":"ContainerDied","Data":"aca12e47df64b63c5518fa1122c147fdc1e66f795928603c5ce0d3b5ee51cb2e"} May 21 17:40:33.588316 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:33.588320 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aca12e47df64b63c5518fa1122c147fdc1e66f795928603c5ce0d3b5ee51cb2e" May 21 17:40:33.588507 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:33.588352 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azk85l" May 21 17:40:40.892287 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892249 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn"] May 21 17:40:40.892700 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892636 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="pull" May 21 17:40:40.892700 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892651 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="pull" May 21 17:40:40.892700 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892676 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="extract" May 21 17:40:40.892700 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892684 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="extract" May 21 17:40:40.892863 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892702 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="util" May 21 17:40:40.892863 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892711 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="util" May 21 17:40:40.892863 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.892771 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d134f22-7ae5-4b1e-a5bc-033627f92f98" containerName="extract" May 21 17:40:40.897990 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.897963 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:40.900351 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.900330 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 17:40:40.900502 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.900380 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xkb62\"" May 21 17:40:40.900811 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.900690 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 17:40:40.900811 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.900713 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 17:40:40.900811 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.900725 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 17:40:40.904448 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:40.904415 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn"] May 21 17:40:41.051360 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051324 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.051517 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051364 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.051517 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051408 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.051517 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051431 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-689dg\" (UniqueName: \"kubernetes.io/projected/ddf4c4d8-641e-4c1c-9c78-5a270a514836-kube-api-access-689dg\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.051517 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051451 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.051517 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051499 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf4c4d8-641e-4c1c-9c78-5a270a514836-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.051694 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.051547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152225 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152132 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-689dg\" (UniqueName: \"kubernetes.io/projected/ddf4c4d8-641e-4c1c-9c78-5a270a514836-kube-api-access-689dg\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152225 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152175 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152225 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152196 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf4c4d8-641e-4c1c-9c78-5a270a514836-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152233 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152281 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152308 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.152490 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.152350 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.153119 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.153091 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.154794 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.154768 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf4c4d8-641e-4c1c-9c78-5a270a514836-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.154938 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.154923 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.155112 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.155092 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.155149 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.155097 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ddf4c4d8-641e-4c1c-9c78-5a270a514836-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.159771 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.159744 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf4c4d8-641e-4c1c-9c78-5a270a514836-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.160152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.160131 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-689dg\" (UniqueName: \"kubernetes.io/projected/ddf4c4d8-641e-4c1c-9c78-5a270a514836-kube-api-access-689dg\") pod \"istiod-openshift-gateway-798958bb55-q8ppn\" (UID: \"ddf4c4d8-641e-4c1c-9c78-5a270a514836\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.209982 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.209939 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:41.347221 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.347189 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn"] May 21 17:40:41.349378 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:40:41.349348 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf4c4d8_641e_4c1c_9c78_5a270a514836.slice/crio-09cb57fe898cb19be211b24ce04d420e6573ee794f9fd7fd835aab21d7e1b25a WatchSource:0}: Error finding container 09cb57fe898cb19be211b24ce04d420e6573ee794f9fd7fd835aab21d7e1b25a: Status 404 returned error can't find the container with id 09cb57fe898cb19be211b24ce04d420e6573ee794f9fd7fd835aab21d7e1b25a May 21 17:40:41.622912 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:41.622811 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" event={"ID":"ddf4c4d8-641e-4c1c-9c78-5a270a514836","Type":"ContainerStarted","Data":"09cb57fe898cb19be211b24ce04d420e6573ee794f9fd7fd835aab21d7e1b25a"} May 21 17:40:42.585602 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:42.585570 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2zw2" May 21 17:40:44.186683 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:44.186632 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 17:40:44.186941 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:44.186725 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 17:40:44.641292 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:44.641252 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" event={"ID":"ddf4c4d8-641e-4c1c-9c78-5a270a514836","Type":"ContainerStarted","Data":"5003c219da6726386434f65756e9a4879dd36ad447bb3968b3ced7715aa717e3"} May 21 17:40:44.641441 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:44.641368 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:44.659976 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:44.659915 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" podStartSLOduration=1.824998476 podStartE2EDuration="4.65989714s" podCreationTimestamp="2026-05-21 17:40:40 +0000 UTC" firstStartedPulling="2026-05-21 17:40:41.351489596 +0000 UTC m=+492.784393275" lastFinishedPulling="2026-05-21 17:40:44.186388258 +0000 UTC m=+495.619291939" observedRunningTime="2026-05-21 17:40:44.659136196 +0000 UTC m=+496.092039919" watchObservedRunningTime="2026-05-21 17:40:44.65989714 +0000 UTC m=+496.092800846" May 21 17:40:45.646954 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:45.646927 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q8ppn" May 21 17:40:57.562703 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:40:57.562672 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-zzknx" May 21 17:41:29.755572 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.755528 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r"] May 21 17:41:29.762574 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.762543 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.765196 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.765164 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 17:41:29.766129 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.766106 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w8sdk\"" May 21 17:41:29.766266 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.766109 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r"] May 21 17:41:29.766266 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.766149 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 17:41:29.839507 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.839465 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzl58\" (UniqueName: \"kubernetes.io/projected/a30553fe-c75c-44d7-8040-aad05f741726-kube-api-access-gzl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.839692 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.839532 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.839692 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.839614 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.940340 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.940293 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.940340 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.940345 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.940558 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.940387 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzl58\" (UniqueName: \"kubernetes.io/projected/a30553fe-c75c-44d7-8040-aad05f741726-kube-api-access-gzl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.940698 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.940677 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.940770 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.940748 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:29.948592 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:29.948570 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzl58\" (UniqueName: \"kubernetes.io/projected/a30553fe-c75c-44d7-8040-aad05f741726-kube-api-access-gzl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:30.073345 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.073251 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:30.203641 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.203606 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r"] May 21 17:41:30.205026 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:41:30.204998 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30553fe_c75c_44d7_8040_aad05f741726.slice/crio-12d588fad30639d497cd4880d136149e4d8df5a1556510fdfdbca99a72414bd2 WatchSource:0}: Error finding container 12d588fad30639d497cd4880d136149e4d8df5a1556510fdfdbca99a72414bd2: Status 404 returned error can't find the container with id 12d588fad30639d497cd4880d136149e4d8df5a1556510fdfdbca99a72414bd2 May 21 17:41:30.355835 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.355740 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x"] May 21 17:41:30.359211 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.359191 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.366545 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.366515 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x"] May 21 17:41:30.444112 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.444081 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.444112 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.444117 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.444322 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.444172 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f68k\" (UniqueName: \"kubernetes.io/projected/0b859a49-6aba-4c81-b8f2-aa3840c20e42-kube-api-access-8f68k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.544801 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.544757 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.544801 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.544802 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.545024 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.544836 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f68k\" (UniqueName: \"kubernetes.io/projected/0b859a49-6aba-4c81-b8f2-aa3840c20e42-kube-api-access-8f68k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.545177 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.545157 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.545221 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.545196 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.555994 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.555961 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f68k\" (UniqueName: \"kubernetes.io/projected/0b859a49-6aba-4c81-b8f2-aa3840c20e42-kube-api-access-8f68k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.706301 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.706261 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:30.809405 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.809374 2551 generic.go:358] "Generic (PLEG): container finished" podID="a30553fe-c75c-44d7-8040-aad05f741726" containerID="546b58fd9ad67fbb5e2884c6c31b62b4b5e58a2b773ce40bf7188b4875ec4a13" exitCode=0 May 21 17:41:30.809773 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.809424 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" event={"ID":"a30553fe-c75c-44d7-8040-aad05f741726","Type":"ContainerDied","Data":"546b58fd9ad67fbb5e2884c6c31b62b4b5e58a2b773ce40bf7188b4875ec4a13"} May 21 17:41:30.809773 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.809449 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" event={"ID":"a30553fe-c75c-44d7-8040-aad05f741726","Type":"ContainerStarted","Data":"12d588fad30639d497cd4880d136149e4d8df5a1556510fdfdbca99a72414bd2"} May 21 17:41:30.833489 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.833462 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x"] May 21 17:41:30.835572 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:41:30.835548 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b859a49_6aba_4c81_b8f2_aa3840c20e42.slice/crio-8bacd14ef886fda271751712459a6435c91f570e0f151dbe41a6b6da71ab9eea WatchSource:0}: Error finding container 8bacd14ef886fda271751712459a6435c91f570e0f151dbe41a6b6da71ab9eea: Status 404 returned error can't find the container with id 8bacd14ef886fda271751712459a6435c91f570e0f151dbe41a6b6da71ab9eea May 21 17:41:30.946916 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.946882 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w"] May 21 17:41:30.950262 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.950240 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:30.957920 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:30.957850 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w"] May 21 17:41:31.050469 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.050430 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.050643 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.050488 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.050643 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.050545 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/2499ae98-2e0a-4229-9d3c-d21c2a789d44-kube-api-access-zvdn5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.151954 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.151914 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/2499ae98-2e0a-4229-9d3c-d21c2a789d44-kube-api-access-zvdn5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.152152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.151965 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.152152 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.152001 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.152326 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.152309 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.152373 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.152358 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.160041 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.160017 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/2499ae98-2e0a-4229-9d3c-d21c2a789d44-kube-api-access-zvdn5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.294499 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.294396 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:31.352572 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.352541 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg"] May 21 17:41:31.357213 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.357189 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.363747 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.363714 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg"] May 21 17:41:31.427920 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.427895 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w"] May 21 17:41:31.429770 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:41:31.429738 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2499ae98_2e0a_4229_9d3c_d21c2a789d44.slice/crio-1d0d9243bb32c47c0436058411c0ef9b317342896933565309242587c0c92778 WatchSource:0}: Error finding container 1d0d9243bb32c47c0436058411c0ef9b317342896933565309242587c0c92778: Status 404 returned error can't find the container with id 1d0d9243bb32c47c0436058411c0ef9b317342896933565309242587c0c92778 May 21 17:41:31.454450 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.454420 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82l2h\" (UniqueName: \"kubernetes.io/projected/4533ba26-c18b-4046-bd69-c602a55400f7-kube-api-access-82l2h\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.454589 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.454466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.454589 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.454551 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.555597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.555529 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82l2h\" (UniqueName: \"kubernetes.io/projected/4533ba26-c18b-4046-bd69-c602a55400f7-kube-api-access-82l2h\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.555597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.555574 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.555768 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.555612 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.555949 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.555934 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.555995 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.555956 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.564215 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.564191 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82l2h\" (UniqueName: \"kubernetes.io/projected/4533ba26-c18b-4046-bd69-c602a55400f7-kube-api-access-82l2h\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.667780 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.667744 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:31.822893 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.822860 2551 generic.go:358] "Generic (PLEG): container finished" podID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerID="fdd1c0ed5ca968c859799bb1a8a26dc8e8326e8b86a3060caee7d4138a8ea58e" exitCode=0 May 21 17:41:31.823310 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.822961 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" event={"ID":"0b859a49-6aba-4c81-b8f2-aa3840c20e42","Type":"ContainerDied","Data":"fdd1c0ed5ca968c859799bb1a8a26dc8e8326e8b86a3060caee7d4138a8ea58e"} May 21 17:41:31.823310 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.822989 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" event={"ID":"0b859a49-6aba-4c81-b8f2-aa3840c20e42","Type":"ContainerStarted","Data":"8bacd14ef886fda271751712459a6435c91f570e0f151dbe41a6b6da71ab9eea"} May 21 17:41:31.824889 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.824601 2551 generic.go:358] "Generic (PLEG): container finished" podID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerID="33becdd4ceac4fd021b47717f771e49d4fcf3092a854645ee62b58ffcd3a5bbf" exitCode=0 May 21 17:41:31.824889 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.824680 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" event={"ID":"2499ae98-2e0a-4229-9d3c-d21c2a789d44","Type":"ContainerDied","Data":"33becdd4ceac4fd021b47717f771e49d4fcf3092a854645ee62b58ffcd3a5bbf"} May 21 17:41:31.824889 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.824705 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" event={"ID":"2499ae98-2e0a-4229-9d3c-d21c2a789d44","Type":"ContainerStarted","Data":"1d0d9243bb32c47c0436058411c0ef9b317342896933565309242587c0c92778"} May 21 17:41:31.852604 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:31.852567 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg"] May 21 17:41:31.855965 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:41:31.855939 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4533ba26_c18b_4046_bd69_c602a55400f7.slice/crio-0de817b176eacd5d9b91a259350f36767c4a24b17820785bc581c326640056c3 WatchSource:0}: Error finding container 0de817b176eacd5d9b91a259350f36767c4a24b17820785bc581c326640056c3: Status 404 returned error can't find the container with id 0de817b176eacd5d9b91a259350f36767c4a24b17820785bc581c326640056c3 May 21 17:41:32.830123 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.830028 2551 generic.go:358] "Generic (PLEG): container finished" podID="a30553fe-c75c-44d7-8040-aad05f741726" containerID="aad347214f49b5bdd56311ae374d263d94d27359838244c1fb2f34c84987b159" exitCode=0 May 21 17:41:32.830123 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.830107 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" event={"ID":"a30553fe-c75c-44d7-8040-aad05f741726","Type":"ContainerDied","Data":"aad347214f49b5bdd56311ae374d263d94d27359838244c1fb2f34c84987b159"} May 21 17:41:32.831671 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.831638 2551 generic.go:358] "Generic (PLEG): container finished" podID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerID="87d633c8a6c67c90325857dc8831e46ed938f28bbb461a29c696884ecf660e62" exitCode=0 May 21 17:41:32.831791 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.831710 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" event={"ID":"0b859a49-6aba-4c81-b8f2-aa3840c20e42","Type":"ContainerDied","Data":"87d633c8a6c67c90325857dc8831e46ed938f28bbb461a29c696884ecf660e62"} May 21 17:41:32.833198 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.833097 2551 generic.go:358] "Generic (PLEG): container finished" podID="4533ba26-c18b-4046-bd69-c602a55400f7" containerID="b89a72321597d326d6733911fc3d8a3edc47b95bb3b8f9be9168d2f30f84677e" exitCode=0 May 21 17:41:32.833198 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.833172 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" event={"ID":"4533ba26-c18b-4046-bd69-c602a55400f7","Type":"ContainerDied","Data":"b89a72321597d326d6733911fc3d8a3edc47b95bb3b8f9be9168d2f30f84677e"} May 21 17:41:32.833302 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.833204 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" event={"ID":"4533ba26-c18b-4046-bd69-c602a55400f7","Type":"ContainerStarted","Data":"0de817b176eacd5d9b91a259350f36767c4a24b17820785bc581c326640056c3"} May 21 17:41:32.834890 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.834869 2551 generic.go:358] "Generic (PLEG): container finished" podID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerID="d211a777f4810ddd73e262d2b7a52940e8d32ff94a741301e52ce7c17603aa0b" exitCode=0 May 21 17:41:32.834982 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:32.834901 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" event={"ID":"2499ae98-2e0a-4229-9d3c-d21c2a789d44","Type":"ContainerDied","Data":"d211a777f4810ddd73e262d2b7a52940e8d32ff94a741301e52ce7c17603aa0b"} May 21 17:41:33.840706 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.840610 2551 generic.go:358] "Generic (PLEG): container finished" podID="a30553fe-c75c-44d7-8040-aad05f741726" containerID="e2aca7e0d0cabaa280c244183c3a4baad8c0b833111b3b6e2e7f1efc9ca2a289" exitCode=0 May 21 17:41:33.840706 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.840693 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" event={"ID":"a30553fe-c75c-44d7-8040-aad05f741726","Type":"ContainerDied","Data":"e2aca7e0d0cabaa280c244183c3a4baad8c0b833111b3b6e2e7f1efc9ca2a289"} May 21 17:41:33.842466 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.842442 2551 generic.go:358] "Generic (PLEG): container finished" podID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerID="a037d2de4870ae75ef9302bda7d69fd5b2ac3c46555d9d8de7d9eadf9ad07bc5" exitCode=0 May 21 17:41:33.842538 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.842507 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" event={"ID":"0b859a49-6aba-4c81-b8f2-aa3840c20e42","Type":"ContainerDied","Data":"a037d2de4870ae75ef9302bda7d69fd5b2ac3c46555d9d8de7d9eadf9ad07bc5"} May 21 17:41:33.844103 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.844080 2551 generic.go:358] "Generic (PLEG): container finished" podID="4533ba26-c18b-4046-bd69-c602a55400f7" containerID="fe0277312b0033addef50a84db5c1ed121878ebd8a916590cb2f2996124c610e" exitCode=0 May 21 17:41:33.844260 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.844148 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" event={"ID":"4533ba26-c18b-4046-bd69-c602a55400f7","Type":"ContainerDied","Data":"fe0277312b0033addef50a84db5c1ed121878ebd8a916590cb2f2996124c610e"} May 21 17:41:33.846130 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.846109 2551 generic.go:358] "Generic (PLEG): container finished" podID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerID="07677d71fd29b4733d5fdcf1943de305a8ca25769532eaa8898814deac327881" exitCode=0 May 21 17:41:33.846217 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:33.846143 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" event={"ID":"2499ae98-2e0a-4229-9d3c-d21c2a789d44","Type":"ContainerDied","Data":"07677d71fd29b4733d5fdcf1943de305a8ca25769532eaa8898814deac327881"} May 21 17:41:34.852005 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:34.851971 2551 generic.go:358] "Generic (PLEG): container finished" podID="4533ba26-c18b-4046-bd69-c602a55400f7" containerID="51f472e2000414c1a6e6031e295472438a132ee1786047612c3445f6e5e6bf13" exitCode=0 May 21 17:41:34.852411 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:34.852064 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" event={"ID":"4533ba26-c18b-4046-bd69-c602a55400f7","Type":"ContainerDied","Data":"51f472e2000414c1a6e6031e295472438a132ee1786047612c3445f6e5e6bf13"} May 21 17:41:34.991740 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:34.991715 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:35.036375 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.036349 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:35.039274 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.039251 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:35.088474 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.088436 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/2499ae98-2e0a-4229-9d3c-d21c2a789d44-kube-api-access-zvdn5\") pod \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " May 21 17:41:35.088620 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.088494 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-bundle\") pod \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " May 21 17:41:35.088676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.088613 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-util\") pod \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\" (UID: \"2499ae98-2e0a-4229-9d3c-d21c2a789d44\") " May 21 17:41:35.089092 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.089070 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-bundle" (OuterVolumeSpecName: "bundle") pod "2499ae98-2e0a-4229-9d3c-d21c2a789d44" (UID: "2499ae98-2e0a-4229-9d3c-d21c2a789d44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:35.090714 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.090695 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2499ae98-2e0a-4229-9d3c-d21c2a789d44-kube-api-access-zvdn5" (OuterVolumeSpecName: "kube-api-access-zvdn5") pod "2499ae98-2e0a-4229-9d3c-d21c2a789d44" (UID: "2499ae98-2e0a-4229-9d3c-d21c2a789d44"). InnerVolumeSpecName "kube-api-access-zvdn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:41:35.093847 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.093797 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-util" (OuterVolumeSpecName: "util") pod "2499ae98-2e0a-4229-9d3c-d21c2a789d44" (UID: "2499ae98-2e0a-4229-9d3c-d21c2a789d44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:35.189608 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189574 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-bundle\") pod \"a30553fe-c75c-44d7-8040-aad05f741726\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " May 21 17:41:35.189608 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189622 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-bundle\") pod \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " May 21 17:41:35.189911 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189643 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-util\") pod \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " May 21 17:41:35.189911 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189665 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzl58\" (UniqueName: \"kubernetes.io/projected/a30553fe-c75c-44d7-8040-aad05f741726-kube-api-access-gzl58\") pod \"a30553fe-c75c-44d7-8040-aad05f741726\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " May 21 17:41:35.189911 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189697 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-util\") pod \"a30553fe-c75c-44d7-8040-aad05f741726\" (UID: \"a30553fe-c75c-44d7-8040-aad05f741726\") " May 21 17:41:35.189911 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189726 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f68k\" (UniqueName: \"kubernetes.io/projected/0b859a49-6aba-4c81-b8f2-aa3840c20e42-kube-api-access-8f68k\") pod \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\" (UID: \"0b859a49-6aba-4c81-b8f2-aa3840c20e42\") " May 21 17:41:35.190117 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189974 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/2499ae98-2e0a-4229-9d3c-d21c2a789d44-kube-api-access-zvdn5\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.190117 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.189993 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.190117 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.190009 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2499ae98-2e0a-4229-9d3c-d21c2a789d44-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.190256 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.190182 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-bundle" (OuterVolumeSpecName: "bundle") pod "a30553fe-c75c-44d7-8040-aad05f741726" (UID: "a30553fe-c75c-44d7-8040-aad05f741726"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:35.190430 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.190404 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-bundle" (OuterVolumeSpecName: "bundle") pod "0b859a49-6aba-4c81-b8f2-aa3840c20e42" (UID: "0b859a49-6aba-4c81-b8f2-aa3840c20e42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:35.192011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.191989 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30553fe-c75c-44d7-8040-aad05f741726-kube-api-access-gzl58" (OuterVolumeSpecName: "kube-api-access-gzl58") pod "a30553fe-c75c-44d7-8040-aad05f741726" (UID: "a30553fe-c75c-44d7-8040-aad05f741726"). InnerVolumeSpecName "kube-api-access-gzl58". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:41:35.192176 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.192158 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b859a49-6aba-4c81-b8f2-aa3840c20e42-kube-api-access-8f68k" (OuterVolumeSpecName: "kube-api-access-8f68k") pod "0b859a49-6aba-4c81-b8f2-aa3840c20e42" (UID: "0b859a49-6aba-4c81-b8f2-aa3840c20e42"). InnerVolumeSpecName "kube-api-access-8f68k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:41:35.195630 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.195607 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-util" (OuterVolumeSpecName: "util") pod "a30553fe-c75c-44d7-8040-aad05f741726" (UID: "a30553fe-c75c-44d7-8040-aad05f741726"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:35.195725 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.195705 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-util" (OuterVolumeSpecName: "util") pod "0b859a49-6aba-4c81-b8f2-aa3840c20e42" (UID: "0b859a49-6aba-4c81-b8f2-aa3840c20e42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:35.290922 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.290877 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.290922 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.290916 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f68k\" (UniqueName: \"kubernetes.io/projected/0b859a49-6aba-4c81-b8f2-aa3840c20e42-kube-api-access-8f68k\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.290922 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.290927 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a30553fe-c75c-44d7-8040-aad05f741726-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.291151 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.290935 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.291151 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.290943 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b859a49-6aba-4c81-b8f2-aa3840c20e42-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.291151 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.290951 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzl58\" (UniqueName: \"kubernetes.io/projected/a30553fe-c75c-44d7-8040-aad05f741726-kube-api-access-gzl58\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:35.857190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.857151 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" event={"ID":"a30553fe-c75c-44d7-8040-aad05f741726","Type":"ContainerDied","Data":"12d588fad30639d497cd4880d136149e4d8df5a1556510fdfdbca99a72414bd2"} May 21 17:41:35.857190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.857175 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r" May 21 17:41:35.857190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.857192 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12d588fad30639d497cd4880d136149e4d8df5a1556510fdfdbca99a72414bd2" May 21 17:41:35.858873 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.858849 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" event={"ID":"0b859a49-6aba-4c81-b8f2-aa3840c20e42","Type":"ContainerDied","Data":"8bacd14ef886fda271751712459a6435c91f570e0f151dbe41a6b6da71ab9eea"} May 21 17:41:35.858970 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.858878 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bacd14ef886fda271751712459a6435c91f570e0f151dbe41a6b6da71ab9eea" May 21 17:41:35.858970 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.858906 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x" May 21 17:41:35.860402 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.860376 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" event={"ID":"2499ae98-2e0a-4229-9d3c-d21c2a789d44","Type":"ContainerDied","Data":"1d0d9243bb32c47c0436058411c0ef9b317342896933565309242587c0c92778"} May 21 17:41:35.860511 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.860405 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d0d9243bb32c47c0436058411c0ef9b317342896933565309242587c0c92778" May 21 17:41:35.860511 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.860423 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w" May 21 17:41:35.989988 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:35.989959 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:36.097879 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.097808 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-bundle\") pod \"4533ba26-c18b-4046-bd69-c602a55400f7\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " May 21 17:41:36.098059 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.097912 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-util\") pod \"4533ba26-c18b-4046-bd69-c602a55400f7\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " May 21 17:41:36.098059 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.097954 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82l2h\" (UniqueName: \"kubernetes.io/projected/4533ba26-c18b-4046-bd69-c602a55400f7-kube-api-access-82l2h\") pod \"4533ba26-c18b-4046-bd69-c602a55400f7\" (UID: \"4533ba26-c18b-4046-bd69-c602a55400f7\") " May 21 17:41:36.098344 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.098320 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-bundle" (OuterVolumeSpecName: "bundle") pod "4533ba26-c18b-4046-bd69-c602a55400f7" (UID: "4533ba26-c18b-4046-bd69-c602a55400f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:36.100044 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.100021 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4533ba26-c18b-4046-bd69-c602a55400f7-kube-api-access-82l2h" (OuterVolumeSpecName: "kube-api-access-82l2h") pod "4533ba26-c18b-4046-bd69-c602a55400f7" (UID: "4533ba26-c18b-4046-bd69-c602a55400f7"). InnerVolumeSpecName "kube-api-access-82l2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:41:36.103326 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.103299 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-util" (OuterVolumeSpecName: "util") pod "4533ba26-c18b-4046-bd69-c602a55400f7" (UID: "4533ba26-c18b-4046-bd69-c602a55400f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:41:36.198772 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.198719 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-bundle\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:36.198772 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.198765 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4533ba26-c18b-4046-bd69-c602a55400f7-util\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:36.198772 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.198778 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82l2h\" (UniqueName: \"kubernetes.io/projected/4533ba26-c18b-4046-bd69-c602a55400f7-kube-api-access-82l2h\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:41:36.865455 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.865420 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" event={"ID":"4533ba26-c18b-4046-bd69-c602a55400f7","Type":"ContainerDied","Data":"0de817b176eacd5d9b91a259350f36767c4a24b17820785bc581c326640056c3"} May 21 17:41:36.865455 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.865454 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0de817b176eacd5d9b91a259350f36767c4a24b17820785bc581c326640056c3" May 21 17:41:36.865455 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:36.865452 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg" May 21 17:41:50.058239 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058201 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-kk2bn"] May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058469 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058480 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058487 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058493 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058502 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058507 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058514 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058521 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058529 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058534 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058542 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058547 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058553 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058557 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058566 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058573 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="util" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058582 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058589 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058598 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058604 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="pull" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058613 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058618 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058625 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058630 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058689 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="2499ae98-2e0a-4229-9d3c-d21c2a789d44" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058696 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="4533ba26-c18b-4046-bd69-c602a55400f7" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058705 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b859a49-6aba-4c81-b8f2-aa3840c20e42" containerName="extract" May 21 17:41:50.058697 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.058713 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="a30553fe-c75c-44d7-8040-aad05f741726" containerName="extract" May 21 17:41:50.061526 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.061511 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:41:50.064341 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.064320 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 17:41:50.064456 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.064324 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8wfhr\"" May 21 17:41:50.065622 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.065606 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 17:41:50.070177 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.070152 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-kk2bn"] May 21 17:41:50.216647 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.216605 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m7m5\" (UniqueName: \"kubernetes.io/projected/a6e2e100-a04e-4e96-a1a3-ad779c996a9f-kube-api-access-2m7m5\") pod \"authorino-operator-657f44b778-kk2bn\" (UID: \"a6e2e100-a04e-4e96-a1a3-ad779c996a9f\") " pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:41:50.317940 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.317843 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2m7m5\" (UniqueName: \"kubernetes.io/projected/a6e2e100-a04e-4e96-a1a3-ad779c996a9f-kube-api-access-2m7m5\") pod \"authorino-operator-657f44b778-kk2bn\" (UID: \"a6e2e100-a04e-4e96-a1a3-ad779c996a9f\") " pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:41:50.330569 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.330540 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m7m5\" (UniqueName: \"kubernetes.io/projected/a6e2e100-a04e-4e96-a1a3-ad779c996a9f-kube-api-access-2m7m5\") pod \"authorino-operator-657f44b778-kk2bn\" (UID: \"a6e2e100-a04e-4e96-a1a3-ad779c996a9f\") " pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:41:50.372672 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.372640 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:41:50.504470 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.504434 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-kk2bn"] May 21 17:41:50.508121 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:41:50.508090 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e2e100_a04e_4e96_a1a3_ad779c996a9f.slice/crio-da4660430c1f4ed09813ced6ae43f2e78f4315a196259ee11533ca7624cdb523 WatchSource:0}: Error finding container da4660430c1f4ed09813ced6ae43f2e78f4315a196259ee11533ca7624cdb523: Status 404 returned error can't find the container with id da4660430c1f4ed09813ced6ae43f2e78f4315a196259ee11533ca7624cdb523 May 21 17:41:50.915277 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:50.915240 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" event={"ID":"a6e2e100-a04e-4e96-a1a3-ad779c996a9f","Type":"ContainerStarted","Data":"da4660430c1f4ed09813ced6ae43f2e78f4315a196259ee11533ca7624cdb523"} May 21 17:41:52.930155 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:52.930121 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" event={"ID":"a6e2e100-a04e-4e96-a1a3-ad779c996a9f","Type":"ContainerStarted","Data":"075eaf95fd185a6917cab9791bbe9c79737b4355bb448320ce419246e53dccdf"} May 21 17:41:52.930562 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:52.930187 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:41:52.956778 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:41:52.956725 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" podStartSLOduration=0.991750999 podStartE2EDuration="2.956711743s" podCreationTimestamp="2026-05-21 17:41:50 +0000 UTC" firstStartedPulling="2026-05-21 17:41:50.509894892 +0000 UTC m=+561.942798574" lastFinishedPulling="2026-05-21 17:41:52.474855622 +0000 UTC m=+563.907759318" observedRunningTime="2026-05-21 17:41:52.955062943 +0000 UTC m=+564.387966644" watchObservedRunningTime="2026-05-21 17:41:52.956711743 +0000 UTC m=+564.389615440" May 21 17:42:03.937163 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:03.937129 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-kk2bn" May 21 17:42:06.012695 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.012654 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg"] May 21 17:42:06.016445 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.016392 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.019805 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.019782 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s49l4\"" May 21 17:42:06.028890 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.028866 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg"] May 21 17:42:06.040269 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.040233 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qzjm\" (UniqueName: \"kubernetes.io/projected/caf0abf4-2e5f-4408-a798-f141a6bf93c8-kube-api-access-8qzjm\") pod \"kuadrant-operator-controller-manager-84b657d985-tfthg\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.040432 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.040299 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf0abf4-2e5f-4408-a798-f141a6bf93c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-tfthg\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.141206 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.141160 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qzjm\" (UniqueName: \"kubernetes.io/projected/caf0abf4-2e5f-4408-a798-f141a6bf93c8-kube-api-access-8qzjm\") pod \"kuadrant-operator-controller-manager-84b657d985-tfthg\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.141418 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.141252 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf0abf4-2e5f-4408-a798-f141a6bf93c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-tfthg\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.141674 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.141651 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf0abf4-2e5f-4408-a798-f141a6bf93c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-tfthg\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.152378 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.152345 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qzjm\" (UniqueName: \"kubernetes.io/projected/caf0abf4-2e5f-4408-a798-f141a6bf93c8-kube-api-access-8qzjm\") pod \"kuadrant-operator-controller-manager-84b657d985-tfthg\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.332235 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.332119 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:06.468432 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.468399 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg"] May 21 17:42:06.469514 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:42:06.469486 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf0abf4_2e5f_4408_a798_f141a6bf93c8.slice/crio-5ab538ef19962af6fb4c6fe327d3078c659594f57e602970a6cc4757f6f77cc3 WatchSource:0}: Error finding container 5ab538ef19962af6fb4c6fe327d3078c659594f57e602970a6cc4757f6f77cc3: Status 404 returned error can't find the container with id 5ab538ef19962af6fb4c6fe327d3078c659594f57e602970a6cc4757f6f77cc3 May 21 17:42:06.555133 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.555089 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg"] May 21 17:42:06.568034 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.567996 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg"] May 21 17:42:06.580335 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.580302 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b"] May 21 17:42:06.585249 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.585172 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.599385 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.599349 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b"] May 21 17:42:06.645758 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.645718 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-lpm6b\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.645969 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.645764 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptm2x\" (UniqueName: \"kubernetes.io/projected/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-kube-api-access-ptm2x\") pod \"kuadrant-operator-controller-manager-84b657d985-lpm6b\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.746417 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.746374 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-lpm6b\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.746417 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.746421 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptm2x\" (UniqueName: \"kubernetes.io/projected/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-kube-api-access-ptm2x\") pod \"kuadrant-operator-controller-manager-84b657d985-lpm6b\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.746781 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.746759 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-lpm6b\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.758031 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.757995 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptm2x\" (UniqueName: \"kubernetes.io/projected/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-kube-api-access-ptm2x\") pod \"kuadrant-operator-controller-manager-84b657d985-lpm6b\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:06.899800 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:06.899757 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:07.042714 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:07.042681 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b"] May 21 17:42:07.055909 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:42:07.055870 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ae8297_2dc6_4c4c_bdba_3c0b1668b8c5.slice/crio-4ac4518f1f15d655531e06ce9edeea2c868e91772c2bba264ae9f4aa8c818f32 WatchSource:0}: Error finding container 4ac4518f1f15d655531e06ce9edeea2c868e91772c2bba264ae9f4aa8c818f32: Status 404 returned error can't find the container with id 4ac4518f1f15d655531e06ce9edeea2c868e91772c2bba264ae9f4aa8c818f32 May 21 17:42:07.991323 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:07.991287 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" event={"ID":"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5","Type":"ContainerStarted","Data":"4ac4518f1f15d655531e06ce9edeea2c868e91772c2bba264ae9f4aa8c818f32"} May 21 17:42:11.006091 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.006029 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" containerName="manager" containerID="cri-o://b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc" gracePeriod=2 May 21 17:42:11.007344 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.007315 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" event={"ID":"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5","Type":"ContainerStarted","Data":"97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409"} May 21 17:42:11.007518 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.007501 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:11.008123 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.008100 2551 status_manager.go:895] "Failed to get status for pod" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" err="pods \"kuadrant-operator-controller-manager-84b657d985-tfthg\" is forbidden: User \"system:node:ip-10-0-130-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-70.ec2.internal' and this object" May 21 17:42:11.025693 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.025628 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" podStartSLOduration=1.56730906 podStartE2EDuration="5.025610413s" podCreationTimestamp="2026-05-21 17:42:06 +0000 UTC" firstStartedPulling="2026-05-21 17:42:07.058288291 +0000 UTC m=+578.491191969" lastFinishedPulling="2026-05-21 17:42:10.516589629 +0000 UTC m=+581.949493322" observedRunningTime="2026-05-21 17:42:11.023612305 +0000 UTC m=+582.456516007" watchObservedRunningTime="2026-05-21 17:42:11.025610413 +0000 UTC m=+582.458514114" May 21 17:42:11.025866 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.025728 2551 status_manager.go:895] "Failed to get status for pod" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" err="pods \"kuadrant-operator-controller-manager-84b657d985-tfthg\" is forbidden: User \"system:node:ip-10-0-130-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-70.ec2.internal' and this object" May 21 17:42:11.240491 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.240467 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:11.242623 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.242597 2551 status_manager.go:895] "Failed to get status for pod" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" err="pods \"kuadrant-operator-controller-manager-84b657d985-tfthg\" is forbidden: User \"system:node:ip-10-0-130-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-70.ec2.internal' and this object" May 21 17:42:11.285831 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.285715 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qzjm\" (UniqueName: \"kubernetes.io/projected/caf0abf4-2e5f-4408-a798-f141a6bf93c8-kube-api-access-8qzjm\") pod \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " May 21 17:42:11.286004 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.285837 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf0abf4-2e5f-4408-a798-f141a6bf93c8-extensions-socket-volume\") pod \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\" (UID: \"caf0abf4-2e5f-4408-a798-f141a6bf93c8\") " May 21 17:42:11.286261 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.286235 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf0abf4-2e5f-4408-a798-f141a6bf93c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "caf0abf4-2e5f-4408-a798-f141a6bf93c8" (UID: "caf0abf4-2e5f-4408-a798-f141a6bf93c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:42:11.287929 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.287894 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf0abf4-2e5f-4408-a798-f141a6bf93c8-kube-api-access-8qzjm" (OuterVolumeSpecName: "kube-api-access-8qzjm") pod "caf0abf4-2e5f-4408-a798-f141a6bf93c8" (UID: "caf0abf4-2e5f-4408-a798-f141a6bf93c8"). InnerVolumeSpecName "kube-api-access-8qzjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:42:11.387336 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.387296 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qzjm\" (UniqueName: \"kubernetes.io/projected/caf0abf4-2e5f-4408-a798-f141a6bf93c8-kube-api-access-8qzjm\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:42:11.387336 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:11.387337 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf0abf4-2e5f-4408-a798-f141a6bf93c8-extensions-socket-volume\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:42:12.011478 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.011445 2551 generic.go:358] "Generic (PLEG): container finished" podID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" containerID="b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc" exitCode=2 May 21 17:42:12.011983 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.011493 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" May 21 17:42:12.011983 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.011547 2551 scope.go:117] "RemoveContainer" containerID="b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc" May 21 17:42:12.013691 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.013665 2551 status_manager.go:895] "Failed to get status for pod" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" err="pods \"kuadrant-operator-controller-manager-84b657d985-tfthg\" is forbidden: User \"system:node:ip-10-0-130-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-70.ec2.internal' and this object" May 21 17:42:12.021023 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.021004 2551 scope.go:117] "RemoveContainer" containerID="b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc" May 21 17:42:12.021335 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:42:12.021316 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc\": container with ID starting with b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc not found: ID does not exist" containerID="b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc" May 21 17:42:12.021384 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.021345 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc"} err="failed to get container status \"b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc\": rpc error: code = NotFound desc = could not find container \"b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc\": container with ID starting with b86e7431fe89fe042e87a1c7368fca70ee0e2b8acfb3b4bbe4aa41ce5aecd2fc not found: ID does not exist" May 21 17:42:12.022412 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:12.022388 2551 status_manager.go:895] "Failed to get status for pod" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tfthg" err="pods \"kuadrant-operator-controller-manager-84b657d985-tfthg\" is forbidden: User \"system:node:ip-10-0-130-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-70.ec2.internal' and this object" May 21 17:42:13.136905 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:13.136869 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" path="/var/lib/kubelet/pods/caf0abf4-2e5f-4408-a798-f141a6bf93c8/volumes" May 21 17:42:22.014433 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:22.014403 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:29.125636 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:29.125612 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:42:29.125986 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:29.125612 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:42:34.836405 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:34.836368 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b"] May 21 17:42:34.836992 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:34.836604 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" podUID="81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" containerName="manager" containerID="cri-o://97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409" gracePeriod=10 May 21 17:42:35.086265 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.086241 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:35.100092 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.099995 2551 generic.go:358] "Generic (PLEG): container finished" podID="81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" containerID="97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409" exitCode=0 May 21 17:42:35.100092 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.100069 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" May 21 17:42:35.100339 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.100074 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" event={"ID":"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5","Type":"ContainerDied","Data":"97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409"} May 21 17:42:35.100339 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.100183 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b" event={"ID":"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5","Type":"ContainerDied","Data":"4ac4518f1f15d655531e06ce9edeea2c868e91772c2bba264ae9f4aa8c818f32"} May 21 17:42:35.100339 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.100200 2551 scope.go:117] "RemoveContainer" containerID="97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409" May 21 17:42:35.110691 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.110669 2551 scope.go:117] "RemoveContainer" containerID="97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409" May 21 17:42:35.111053 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:42:35.111032 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409\": container with ID starting with 97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409 not found: ID does not exist" containerID="97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409" May 21 17:42:35.111140 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.111061 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409"} err="failed to get container status \"97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409\": rpc error: code = NotFound desc = could not find container \"97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409\": container with ID starting with 97a1803620bda523fd35190d3c8cb74f356a7889f653abd729618d7aff835409 not found: ID does not exist" May 21 17:42:35.181255 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.181220 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-extensions-socket-volume\") pod \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " May 21 17:42:35.181428 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.181290 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptm2x\" (UniqueName: \"kubernetes.io/projected/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-kube-api-access-ptm2x\") pod \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\" (UID: \"81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5\") " May 21 17:42:35.181624 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.181599 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" (UID: "81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 17:42:35.183308 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.183286 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-kube-api-access-ptm2x" (OuterVolumeSpecName: "kube-api-access-ptm2x") pod "81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" (UID: "81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5"). InnerVolumeSpecName "kube-api-access-ptm2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:42:35.282543 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.282510 2551 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-extensions-socket-volume\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:42:35.282698 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.282563 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptm2x\" (UniqueName: \"kubernetes.io/projected/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5-kube-api-access-ptm2x\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:42:35.425508 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.425476 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b"] May 21 17:42:35.428289 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:35.428261 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-lpm6b"] May 21 17:42:37.136868 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:37.136812 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" path="/var/lib/kubelet/pods/81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5/volumes" May 21 17:42:38.274681 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.274637 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc"] May 21 17:42:38.275104 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.274942 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" containerName="manager" May 21 17:42:38.275104 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.274955 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" containerName="manager" May 21 17:42:38.275104 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.274971 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" containerName="manager" May 21 17:42:38.275104 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.274976 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" containerName="manager" May 21 17:42:38.275104 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.275027 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="81ae8297-2dc6-4c4c-bdba-3c0b1668b8c5" containerName="manager" May 21 17:42:38.275104 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.275034 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="caf0abf4-2e5f-4408-a798-f141a6bf93c8" containerName="manager" May 21 17:42:38.279328 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.279300 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.282011 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.281983 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g8w4t\"" May 21 17:42:38.289032 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.288999 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc"] May 21 17:42:38.406757 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.406705 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.406757 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.406753 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407028 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.406771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5llks\" (UniqueName: \"kubernetes.io/projected/be5fabf0-fcee-41bb-8047-25fcb1b913e7-kube-api-access-5llks\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407028 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.406904 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407028 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.406949 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407028 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.406983 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407028 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.407022 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407419 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.407130 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.407419 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.407186 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508139 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508090 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508139 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508141 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508166 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508193 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508244 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508288 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508322 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508351 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508401 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508376 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5llks\" (UniqueName: \"kubernetes.io/projected/be5fabf0-fcee-41bb-8047-25fcb1b913e7-kube-api-access-5llks\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508736 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508610 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508736 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508659 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508736 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508699 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.508907 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.508886 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.509216 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.509191 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.510742 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.510714 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.510953 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.510927 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.515703 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.515680 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be5fabf0-fcee-41bb-8047-25fcb1b913e7-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.515949 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.515927 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5llks\" (UniqueName: \"kubernetes.io/projected/be5fabf0-fcee-41bb-8047-25fcb1b913e7-kube-api-access-5llks\") pod \"maas-default-gateway-openshift-default-7df95f575-g45hc\" (UID: \"be5fabf0-fcee-41bb-8047-25fcb1b913e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.593075 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.592974 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:38.730110 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:38.730076 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc"] May 21 17:42:38.732775 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:42:38.732734 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5fabf0_fcee_41bb_8047_25fcb1b913e7.slice/crio-62e618926ce3ab54587ce0988d8497344fa2b84a9c62ac0b8b0e5eabb1964fdb WatchSource:0}: Error finding container 62e618926ce3ab54587ce0988d8497344fa2b84a9c62ac0b8b0e5eabb1964fdb: Status 404 returned error can't find the container with id 62e618926ce3ab54587ce0988d8497344fa2b84a9c62ac0b8b0e5eabb1964fdb May 21 17:42:39.116633 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:39.116590 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" event={"ID":"be5fabf0-fcee-41bb-8047-25fcb1b913e7","Type":"ContainerStarted","Data":"62e618926ce3ab54587ce0988d8497344fa2b84a9c62ac0b8b0e5eabb1964fdb"} May 21 17:42:41.793483 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:41.793443 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 17:42:41.793782 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:41.793517 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 17:42:41.793782 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:41.793556 2551 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 17:42:42.129783 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:42.129696 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" event={"ID":"be5fabf0-fcee-41bb-8047-25fcb1b913e7","Type":"ContainerStarted","Data":"5b10981ed5c53518e327ac8eada7ec75127852118ff65c9dc81fca3bfc7aa4bd"} May 21 17:42:42.149537 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:42.149487 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" podStartSLOduration=1.091398972 podStartE2EDuration="4.149474057s" podCreationTimestamp="2026-05-21 17:42:38 +0000 UTC" firstStartedPulling="2026-05-21 17:42:38.735128303 +0000 UTC m=+610.168031986" lastFinishedPulling="2026-05-21 17:42:41.793203388 +0000 UTC m=+613.226107071" observedRunningTime="2026-05-21 17:42:42.147803499 +0000 UTC m=+613.580707201" watchObservedRunningTime="2026-05-21 17:42:42.149474057 +0000 UTC m=+613.582377757" May 21 17:42:42.593714 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:42.593675 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:42.598658 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:42.598635 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:43.136089 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:43.136060 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:43.136482 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:43.136117 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-g45hc" May 21 17:42:57.267330 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.267222 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:42:57.270463 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.270443 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.272912 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.272889 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 17:42:57.273079 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.273056 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w8sdk\"" May 21 17:42:57.280770 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.280741 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:42:57.365881 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.365840 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:42:57.371328 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.371281 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmts9\" (UniqueName: \"kubernetes.io/projected/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-kube-api-access-gmts9\") pod \"limitador-limitador-7d549b5b-xrz5d\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.371512 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.371422 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-config-file\") pod \"limitador-limitador-7d549b5b-xrz5d\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.472418 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.472314 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-config-file\") pod \"limitador-limitador-7d549b5b-xrz5d\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.472595 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.472474 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmts9\" (UniqueName: \"kubernetes.io/projected/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-kube-api-access-gmts9\") pod \"limitador-limitador-7d549b5b-xrz5d\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.473070 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.473046 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-config-file\") pod \"limitador-limitador-7d549b5b-xrz5d\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.480448 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.480410 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmts9\" (UniqueName: \"kubernetes.io/projected/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-kube-api-access-gmts9\") pod \"limitador-limitador-7d549b5b-xrz5d\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.581789 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.581689 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:42:57.722010 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:57.721983 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:42:57.724425 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:42:57.724398 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c6e6ec_ca58_48ac_929d_e5923b2e3124.slice/crio-3b0ff84245e15750acfd356eab2718d75970811fdfdbcc60c62ea7cdef9e1432 WatchSource:0}: Error finding container 3b0ff84245e15750acfd356eab2718d75970811fdfdbcc60c62ea7cdef9e1432: Status 404 returned error can't find the container with id 3b0ff84245e15750acfd356eab2718d75970811fdfdbcc60c62ea7cdef9e1432 May 21 17:42:58.184997 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:42:58.184959 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" event={"ID":"d9c6e6ec-ca58-48ac-929d-e5923b2e3124","Type":"ContainerStarted","Data":"3b0ff84245e15750acfd356eab2718d75970811fdfdbcc60c62ea7cdef9e1432"} May 21 17:43:01.198536 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:01.198502 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" event={"ID":"d9c6e6ec-ca58-48ac-929d-e5923b2e3124","Type":"ContainerStarted","Data":"0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1"} May 21 17:43:01.198933 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:01.198556 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:43:01.214648 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:01.214594 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" podStartSLOduration=1.642323535 podStartE2EDuration="4.214579186s" podCreationTimestamp="2026-05-21 17:42:57 +0000 UTC" firstStartedPulling="2026-05-21 17:42:57.726444805 +0000 UTC m=+629.159348498" lastFinishedPulling="2026-05-21 17:43:00.298700468 +0000 UTC m=+631.731604149" observedRunningTime="2026-05-21 17:43:01.211805726 +0000 UTC m=+632.644709429" watchObservedRunningTime="2026-05-21 17:43:01.214579186 +0000 UTC m=+632.647482887" May 21 17:43:12.203190 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:12.203161 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:43:12.506017 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:12.505923 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:43:12.506187 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:12.506144 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" podUID="d9c6e6ec-ca58-48ac-929d-e5923b2e3124" containerName="limitador" containerID="cri-o://0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1" gracePeriod=30 May 21 17:43:13.049850 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.049811 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:43:13.105874 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.105772 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmts9\" (UniqueName: \"kubernetes.io/projected/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-kube-api-access-gmts9\") pod \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " May 21 17:43:13.105874 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.105855 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-config-file\") pod \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\" (UID: \"d9c6e6ec-ca58-48ac-929d-e5923b2e3124\") " May 21 17:43:13.106220 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.106188 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-config-file" (OuterVolumeSpecName: "config-file") pod "d9c6e6ec-ca58-48ac-929d-e5923b2e3124" (UID: "d9c6e6ec-ca58-48ac-929d-e5923b2e3124"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 17:43:13.107890 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.107852 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-kube-api-access-gmts9" (OuterVolumeSpecName: "kube-api-access-gmts9") pod "d9c6e6ec-ca58-48ac-929d-e5923b2e3124" (UID: "d9c6e6ec-ca58-48ac-929d-e5923b2e3124"). InnerVolumeSpecName "kube-api-access-gmts9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:43:13.207191 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.207149 2551 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-config-file\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:43:13.207191 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.207183 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmts9\" (UniqueName: \"kubernetes.io/projected/d9c6e6ec-ca58-48ac-929d-e5923b2e3124-kube-api-access-gmts9\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:43:13.246073 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.246041 2551 generic.go:358] "Generic (PLEG): container finished" podID="d9c6e6ec-ca58-48ac-929d-e5923b2e3124" containerID="0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1" exitCode=0 May 21 17:43:13.246237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.246079 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" event={"ID":"d9c6e6ec-ca58-48ac-929d-e5923b2e3124","Type":"ContainerDied","Data":"0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1"} May 21 17:43:13.246237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.246103 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" event={"ID":"d9c6e6ec-ca58-48ac-929d-e5923b2e3124","Type":"ContainerDied","Data":"3b0ff84245e15750acfd356eab2718d75970811fdfdbcc60c62ea7cdef9e1432"} May 21 17:43:13.246237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.246100 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xrz5d" May 21 17:43:13.246237 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.246114 2551 scope.go:117] "RemoveContainer" containerID="0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1" May 21 17:43:13.254652 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.254625 2551 scope.go:117] "RemoveContainer" containerID="0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1" May 21 17:43:13.254987 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:43:13.254965 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1\": container with ID starting with 0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1 not found: ID does not exist" containerID="0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1" May 21 17:43:13.255050 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.254997 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1"} err="failed to get container status \"0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1\": rpc error: code = NotFound desc = could not find container \"0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1\": container with ID starting with 0537410e340b8a47ddb67de47e4b1b06787f28c11a8130d600efd413b17a5ed1 not found: ID does not exist" May 21 17:43:13.262458 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.262428 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:43:13.265480 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.265449 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xrz5d"] May 21 17:43:13.991176 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.991135 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-dm7ff"] May 21 17:43:13.991592 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.991569 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c6e6ec-ca58-48ac-929d-e5923b2e3124" containerName="limitador" May 21 17:43:13.991693 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.991595 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c6e6ec-ca58-48ac-929d-e5923b2e3124" containerName="limitador" May 21 17:43:13.991693 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.991663 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9c6e6ec-ca58-48ac-929d-e5923b2e3124" containerName="limitador" May 21 17:43:13.996158 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.996124 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:13.998536 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.998514 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-74ttq\"" May 21 17:43:13.998620 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:13.998523 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 17:43:14.002429 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.002402 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-dm7ff"] May 21 17:43:14.015713 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.015667 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/325e7a04-b6ad-46c4-9b21-04e208f1f5e2-data\") pod \"postgres-68c4fbbd6f-dm7ff\" (UID: \"325e7a04-b6ad-46c4-9b21-04e208f1f5e2\") " pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.015901 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.015778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5scq\" (UniqueName: \"kubernetes.io/projected/325e7a04-b6ad-46c4-9b21-04e208f1f5e2-kube-api-access-z5scq\") pod \"postgres-68c4fbbd6f-dm7ff\" (UID: \"325e7a04-b6ad-46c4-9b21-04e208f1f5e2\") " pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.117021 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.116985 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5scq\" (UniqueName: \"kubernetes.io/projected/325e7a04-b6ad-46c4-9b21-04e208f1f5e2-kube-api-access-z5scq\") pod \"postgres-68c4fbbd6f-dm7ff\" (UID: \"325e7a04-b6ad-46c4-9b21-04e208f1f5e2\") " pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.117195 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.117037 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/325e7a04-b6ad-46c4-9b21-04e208f1f5e2-data\") pod \"postgres-68c4fbbd6f-dm7ff\" (UID: \"325e7a04-b6ad-46c4-9b21-04e208f1f5e2\") " pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.117384 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.117368 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/325e7a04-b6ad-46c4-9b21-04e208f1f5e2-data\") pod \"postgres-68c4fbbd6f-dm7ff\" (UID: \"325e7a04-b6ad-46c4-9b21-04e208f1f5e2\") " pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.124608 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.124574 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5scq\" (UniqueName: \"kubernetes.io/projected/325e7a04-b6ad-46c4-9b21-04e208f1f5e2-kube-api-access-z5scq\") pod \"postgres-68c4fbbd6f-dm7ff\" (UID: \"325e7a04-b6ad-46c4-9b21-04e208f1f5e2\") " pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.309421 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.309319 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:14.439131 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:14.439099 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-dm7ff"] May 21 17:43:14.440682 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:43:14.440651 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325e7a04_b6ad_46c4_9b21_04e208f1f5e2.slice/crio-03c57ae6b49d55f9b71fa3e04898922f53951490ee3a07b3f26fbd37f4d1034a WatchSource:0}: Error finding container 03c57ae6b49d55f9b71fa3e04898922f53951490ee3a07b3f26fbd37f4d1034a: Status 404 returned error can't find the container with id 03c57ae6b49d55f9b71fa3e04898922f53951490ee3a07b3f26fbd37f4d1034a May 21 17:43:15.136920 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:15.136886 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9c6e6ec-ca58-48ac-929d-e5923b2e3124" path="/var/lib/kubelet/pods/d9c6e6ec-ca58-48ac-929d-e5923b2e3124/volumes" May 21 17:43:15.260349 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:15.260271 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" event={"ID":"325e7a04-b6ad-46c4-9b21-04e208f1f5e2","Type":"ContainerStarted","Data":"03c57ae6b49d55f9b71fa3e04898922f53951490ee3a07b3f26fbd37f4d1034a"} May 21 17:43:20.280763 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:20.280726 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" event={"ID":"325e7a04-b6ad-46c4-9b21-04e208f1f5e2","Type":"ContainerStarted","Data":"95144ee5ba6bcca34ad876fddb600c7394177ded574032dc3d82c30f66dd630e"} May 21 17:43:20.281213 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:20.280872 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:20.294548 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:20.294487 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" podStartSLOduration=2.455355187 podStartE2EDuration="7.294466661s" podCreationTimestamp="2026-05-21 17:43:13 +0000 UTC" firstStartedPulling="2026-05-21 17:43:14.442154072 +0000 UTC m=+645.875057752" lastFinishedPulling="2026-05-21 17:43:19.281265544 +0000 UTC m=+650.714169226" observedRunningTime="2026-05-21 17:43:20.293794046 +0000 UTC m=+651.726697749" watchObservedRunningTime="2026-05-21 17:43:20.294466661 +0000 UTC m=+651.727370344" May 21 17:43:26.314106 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:26.314070 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-dm7ff" May 21 17:43:32.174613 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.174573 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5696cd9478-vtv8c"] May 21 17:43:32.180861 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.180834 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:32.183358 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.183336 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 17:43:32.183442 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.183358 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l7lfd\"" May 21 17:43:32.187107 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.187080 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5696cd9478-vtv8c"] May 21 17:43:32.271247 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.271204 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw7lr\" (UniqueName: \"kubernetes.io/projected/544d4f66-dd11-4b05-ae57-4676d8e70cf3-kube-api-access-lw7lr\") pod \"maas-controller-5696cd9478-vtv8c\" (UID: \"544d4f66-dd11-4b05-ae57-4676d8e70cf3\") " pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:32.308483 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.308444 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c7cf7556b-zv5xv"] May 21 17:43:32.310806 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.310783 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:32.321511 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.321480 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c7cf7556b-zv5xv"] May 21 17:43:32.372383 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.372343 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zdsg\" (UniqueName: \"kubernetes.io/projected/0cc4cfaf-9704-4e37-a671-f89feea0a7a7-kube-api-access-8zdsg\") pod \"maas-controller-5c7cf7556b-zv5xv\" (UID: \"0cc4cfaf-9704-4e37-a671-f89feea0a7a7\") " pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:32.372563 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.372473 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lw7lr\" (UniqueName: \"kubernetes.io/projected/544d4f66-dd11-4b05-ae57-4676d8e70cf3-kube-api-access-lw7lr\") pod \"maas-controller-5696cd9478-vtv8c\" (UID: \"544d4f66-dd11-4b05-ae57-4676d8e70cf3\") " pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:32.380052 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.380019 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw7lr\" (UniqueName: \"kubernetes.io/projected/544d4f66-dd11-4b05-ae57-4676d8e70cf3-kube-api-access-lw7lr\") pod \"maas-controller-5696cd9478-vtv8c\" (UID: \"544d4f66-dd11-4b05-ae57-4676d8e70cf3\") " pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:32.473274 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.473180 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zdsg\" (UniqueName: \"kubernetes.io/projected/0cc4cfaf-9704-4e37-a671-f89feea0a7a7-kube-api-access-8zdsg\") pod \"maas-controller-5c7cf7556b-zv5xv\" (UID: \"0cc4cfaf-9704-4e37-a671-f89feea0a7a7\") " pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:32.481207 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.481146 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zdsg\" (UniqueName: \"kubernetes.io/projected/0cc4cfaf-9704-4e37-a671-f89feea0a7a7-kube-api-access-8zdsg\") pod \"maas-controller-5c7cf7556b-zv5xv\" (UID: \"0cc4cfaf-9704-4e37-a671-f89feea0a7a7\") " pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:32.491968 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.491938 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:32.622171 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.622137 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:32.627487 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.627461 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5696cd9478-vtv8c"] May 21 17:43:32.630164 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:43:32.630133 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544d4f66_dd11_4b05_ae57_4676d8e70cf3.slice/crio-02dcd858c9b74969e0168722e4c73c0f164a4032492557b74e13908b31cc0c92 WatchSource:0}: Error finding container 02dcd858c9b74969e0168722e4c73c0f164a4032492557b74e13908b31cc0c92: Status 404 returned error can't find the container with id 02dcd858c9b74969e0168722e4c73c0f164a4032492557b74e13908b31cc0c92 May 21 17:43:32.762240 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:32.762213 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c7cf7556b-zv5xv"] May 21 17:43:32.764621 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:43:32.764593 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc4cfaf_9704_4e37_a671_f89feea0a7a7.slice/crio-af2de5c643fca6972b4f3030b257b5af3488ae61b0a98302b0fa5cffa5fd1951 WatchSource:0}: Error finding container af2de5c643fca6972b4f3030b257b5af3488ae61b0a98302b0fa5cffa5fd1951: Status 404 returned error can't find the container with id af2de5c643fca6972b4f3030b257b5af3488ae61b0a98302b0fa5cffa5fd1951 May 21 17:43:33.334427 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:33.334385 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" event={"ID":"0cc4cfaf-9704-4e37-a671-f89feea0a7a7","Type":"ContainerStarted","Data":"af2de5c643fca6972b4f3030b257b5af3488ae61b0a98302b0fa5cffa5fd1951"} May 21 17:43:33.337166 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:33.337126 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5696cd9478-vtv8c" event={"ID":"544d4f66-dd11-4b05-ae57-4676d8e70cf3","Type":"ContainerStarted","Data":"02dcd858c9b74969e0168722e4c73c0f164a4032492557b74e13908b31cc0c92"} May 21 17:43:35.347742 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:35.347703 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" event={"ID":"0cc4cfaf-9704-4e37-a671-f89feea0a7a7","Type":"ContainerStarted","Data":"bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7"} May 21 17:43:35.348255 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:35.347788 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:35.349197 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:35.349172 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5696cd9478-vtv8c" event={"ID":"544d4f66-dd11-4b05-ae57-4676d8e70cf3","Type":"ContainerStarted","Data":"094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f"} May 21 17:43:35.349302 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:35.349286 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:35.363291 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:35.363236 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" podStartSLOduration=0.904621764 podStartE2EDuration="3.363220904s" podCreationTimestamp="2026-05-21 17:43:32 +0000 UTC" firstStartedPulling="2026-05-21 17:43:32.766043924 +0000 UTC m=+664.198947606" lastFinishedPulling="2026-05-21 17:43:35.224643068 +0000 UTC m=+666.657546746" observedRunningTime="2026-05-21 17:43:35.361225005 +0000 UTC m=+666.794128710" watchObservedRunningTime="2026-05-21 17:43:35.363220904 +0000 UTC m=+666.796124604" May 21 17:43:35.376521 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:35.376463 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5696cd9478-vtv8c" podStartSLOduration=0.773453561 podStartE2EDuration="3.37644806s" podCreationTimestamp="2026-05-21 17:43:32 +0000 UTC" firstStartedPulling="2026-05-21 17:43:32.631886136 +0000 UTC m=+664.064789816" lastFinishedPulling="2026-05-21 17:43:35.234880637 +0000 UTC m=+666.667784315" observedRunningTime="2026-05-21 17:43:35.374020838 +0000 UTC m=+666.806924539" watchObservedRunningTime="2026-05-21 17:43:35.37644806 +0000 UTC m=+666.809351799" May 21 17:43:46.363515 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.363481 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:46.364148 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.363540 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:46.414179 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.414139 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5696cd9478-vtv8c"] May 21 17:43:46.414408 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.414367 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5696cd9478-vtv8c" podUID="544d4f66-dd11-4b05-ae57-4676d8e70cf3" containerName="manager" containerID="cri-o://094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f" gracePeriod=30 May 21 17:43:46.580233 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.580195 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69dccd4bd-k8lzr"] May 21 17:43:46.583470 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.583436 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:46.593884 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.593852 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-k8lzr"] May 21 17:43:46.654242 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.654219 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:46.692559 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.692525 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bb4p\" (UniqueName: \"kubernetes.io/projected/8d7767bb-8123-44a9-a07a-883344e2a6c9-kube-api-access-9bb4p\") pod \"maas-controller-69dccd4bd-k8lzr\" (UID: \"8d7767bb-8123-44a9-a07a-883344e2a6c9\") " pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:46.793571 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.793511 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw7lr\" (UniqueName: \"kubernetes.io/projected/544d4f66-dd11-4b05-ae57-4676d8e70cf3-kube-api-access-lw7lr\") pod \"544d4f66-dd11-4b05-ae57-4676d8e70cf3\" (UID: \"544d4f66-dd11-4b05-ae57-4676d8e70cf3\") " May 21 17:43:46.793743 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.793627 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bb4p\" (UniqueName: \"kubernetes.io/projected/8d7767bb-8123-44a9-a07a-883344e2a6c9-kube-api-access-9bb4p\") pod \"maas-controller-69dccd4bd-k8lzr\" (UID: \"8d7767bb-8123-44a9-a07a-883344e2a6c9\") " pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:46.795721 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.795687 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544d4f66-dd11-4b05-ae57-4676d8e70cf3-kube-api-access-lw7lr" (OuterVolumeSpecName: "kube-api-access-lw7lr") pod "544d4f66-dd11-4b05-ae57-4676d8e70cf3" (UID: "544d4f66-dd11-4b05-ae57-4676d8e70cf3"). InnerVolumeSpecName "kube-api-access-lw7lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:43:46.801717 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.801691 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bb4p\" (UniqueName: \"kubernetes.io/projected/8d7767bb-8123-44a9-a07a-883344e2a6c9-kube-api-access-9bb4p\") pod \"maas-controller-69dccd4bd-k8lzr\" (UID: \"8d7767bb-8123-44a9-a07a-883344e2a6c9\") " pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:46.894756 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.894648 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw7lr\" (UniqueName: \"kubernetes.io/projected/544d4f66-dd11-4b05-ae57-4676d8e70cf3-kube-api-access-lw7lr\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:43:46.898601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:46.898571 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:47.030130 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.030096 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-k8lzr"] May 21 17:43:47.035257 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:43:47.035225 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7767bb_8123_44a9_a07a_883344e2a6c9.slice/crio-576312943cde3a013d9399d53734e1744f695570833a6329b2f4de7bc17e9cb2 WatchSource:0}: Error finding container 576312943cde3a013d9399d53734e1744f695570833a6329b2f4de7bc17e9cb2: Status 404 returned error can't find the container with id 576312943cde3a013d9399d53734e1744f695570833a6329b2f4de7bc17e9cb2 May 21 17:43:47.398323 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.398297 2551 generic.go:358] "Generic (PLEG): container finished" podID="544d4f66-dd11-4b05-ae57-4676d8e70cf3" containerID="094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f" exitCode=0 May 21 17:43:47.398723 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.398372 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5696cd9478-vtv8c" event={"ID":"544d4f66-dd11-4b05-ae57-4676d8e70cf3","Type":"ContainerDied","Data":"094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f"} May 21 17:43:47.398723 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.398420 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5696cd9478-vtv8c" event={"ID":"544d4f66-dd11-4b05-ae57-4676d8e70cf3","Type":"ContainerDied","Data":"02dcd858c9b74969e0168722e4c73c0f164a4032492557b74e13908b31cc0c92"} May 21 17:43:47.398723 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.398378 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5696cd9478-vtv8c" May 21 17:43:47.398723 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.398440 2551 scope.go:117] "RemoveContainer" containerID="094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f" May 21 17:43:47.400015 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.399986 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" event={"ID":"8d7767bb-8123-44a9-a07a-883344e2a6c9","Type":"ContainerStarted","Data":"576312943cde3a013d9399d53734e1744f695570833a6329b2f4de7bc17e9cb2"} May 21 17:43:47.406370 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.406342 2551 scope.go:117] "RemoveContainer" containerID="094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f" May 21 17:43:47.406660 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:43:47.406627 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f\": container with ID starting with 094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f not found: ID does not exist" containerID="094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f" May 21 17:43:47.406755 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.406668 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f"} err="failed to get container status \"094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f\": rpc error: code = NotFound desc = could not find container \"094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f\": container with ID starting with 094c7ad579918ff050666b2fa73526dcc3841e1c92d55e2d5d6ddd74dbc7c95f not found: ID does not exist" May 21 17:43:47.413930 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.413897 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5696cd9478-vtv8c"] May 21 17:43:47.416862 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:47.416806 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5696cd9478-vtv8c"] May 21 17:43:48.404830 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:48.404779 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" event={"ID":"8d7767bb-8123-44a9-a07a-883344e2a6c9","Type":"ContainerStarted","Data":"3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36"} May 21 17:43:48.405246 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:48.404918 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:48.422306 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:48.422251 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" podStartSLOduration=2.1111282 podStartE2EDuration="2.422234686s" podCreationTimestamp="2026-05-21 17:43:46 +0000 UTC" firstStartedPulling="2026-05-21 17:43:47.036625945 +0000 UTC m=+678.469529627" lastFinishedPulling="2026-05-21 17:43:47.347732434 +0000 UTC m=+678.780636113" observedRunningTime="2026-05-21 17:43:48.420335958 +0000 UTC m=+679.853239652" watchObservedRunningTime="2026-05-21 17:43:48.422234686 +0000 UTC m=+679.855138386" May 21 17:43:49.136511 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:49.136474 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="544d4f66-dd11-4b05-ae57-4676d8e70cf3" path="/var/lib/kubelet/pods/544d4f66-dd11-4b05-ae57-4676d8e70cf3/volumes" May 21 17:43:59.415474 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.415440 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:43:59.453243 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.453206 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c7cf7556b-zv5xv"] May 21 17:43:59.453495 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.453469 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" podUID="0cc4cfaf-9704-4e37-a671-f89feea0a7a7" containerName="manager" containerID="cri-o://bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7" gracePeriod=30 May 21 17:43:59.696355 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.696330 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:43:59.810748 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.810715 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zdsg\" (UniqueName: \"kubernetes.io/projected/0cc4cfaf-9704-4e37-a671-f89feea0a7a7-kube-api-access-8zdsg\") pod \"0cc4cfaf-9704-4e37-a671-f89feea0a7a7\" (UID: \"0cc4cfaf-9704-4e37-a671-f89feea0a7a7\") " May 21 17:43:59.812855 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.812830 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc4cfaf-9704-4e37-a671-f89feea0a7a7-kube-api-access-8zdsg" (OuterVolumeSpecName: "kube-api-access-8zdsg") pod "0cc4cfaf-9704-4e37-a671-f89feea0a7a7" (UID: "0cc4cfaf-9704-4e37-a671-f89feea0a7a7"). InnerVolumeSpecName "kube-api-access-8zdsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:43:59.912408 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:43:59.912357 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zdsg\" (UniqueName: \"kubernetes.io/projected/0cc4cfaf-9704-4e37-a671-f89feea0a7a7-kube-api-access-8zdsg\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:44:00.453121 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.453086 2551 generic.go:358] "Generic (PLEG): container finished" podID="0cc4cfaf-9704-4e37-a671-f89feea0a7a7" containerID="bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7" exitCode=0 May 21 17:44:00.453597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.453149 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" May 21 17:44:00.453597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.453171 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" event={"ID":"0cc4cfaf-9704-4e37-a671-f89feea0a7a7","Type":"ContainerDied","Data":"bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7"} May 21 17:44:00.453597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.453205 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7cf7556b-zv5xv" event={"ID":"0cc4cfaf-9704-4e37-a671-f89feea0a7a7","Type":"ContainerDied","Data":"af2de5c643fca6972b4f3030b257b5af3488ae61b0a98302b0fa5cffa5fd1951"} May 21 17:44:00.453597 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.453220 2551 scope.go:117] "RemoveContainer" containerID="bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7" May 21 17:44:00.462557 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.462538 2551 scope.go:117] "RemoveContainer" containerID="bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7" May 21 17:44:00.462902 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:44:00.462881 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7\": container with ID starting with bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7 not found: ID does not exist" containerID="bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7" May 21 17:44:00.462999 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.462908 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7"} err="failed to get container status \"bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7\": rpc error: code = NotFound desc = could not find container \"bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7\": container with ID starting with bf665a742b118b1959d54d91b4eb3ad1b95b989ae7e474846081a7c4bda9a4c7 not found: ID does not exist" May 21 17:44:00.475522 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.475489 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c7cf7556b-zv5xv"] May 21 17:44:00.477689 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:00.477661 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c7cf7556b-zv5xv"] May 21 17:44:01.137176 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:01.137143 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc4cfaf-9704-4e37-a671-f89feea0a7a7" path="/var/lib/kubelet/pods/0cc4cfaf-9704-4e37-a671-f89feea0a7a7/volumes" May 21 17:44:21.508182 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508087 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5f9d6695cb-7ndtf"] May 21 17:44:21.508661 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508522 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc4cfaf-9704-4e37-a671-f89feea0a7a7" containerName="manager" May 21 17:44:21.508661 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508540 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc4cfaf-9704-4e37-a671-f89feea0a7a7" containerName="manager" May 21 17:44:21.508661 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508556 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="544d4f66-dd11-4b05-ae57-4676d8e70cf3" containerName="manager" May 21 17:44:21.508661 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508563 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="544d4f66-dd11-4b05-ae57-4676d8e70cf3" containerName="manager" May 21 17:44:21.508661 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508651 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="0cc4cfaf-9704-4e37-a671-f89feea0a7a7" containerName="manager" May 21 17:44:21.508661 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.508663 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="544d4f66-dd11-4b05-ae57-4676d8e70cf3" containerName="manager" May 21 17:44:21.510579 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.510559 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.513073 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.513050 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 17:44:21.513192 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.513137 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bgwfd\"" May 21 17:44:21.521529 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.521499 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f9d6695cb-7ndtf"] May 21 17:44:21.590424 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.590380 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46c4\" (UniqueName: \"kubernetes.io/projected/b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea-kube-api-access-j46c4\") pod \"maas-api-5f9d6695cb-7ndtf\" (UID: \"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea\") " pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.590601 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.590443 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea-maas-api-tls\") pod \"maas-api-5f9d6695cb-7ndtf\" (UID: \"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea\") " pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.691901 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.691864 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea-maas-api-tls\") pod \"maas-api-5f9d6695cb-7ndtf\" (UID: \"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea\") " pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.692074 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.692031 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j46c4\" (UniqueName: \"kubernetes.io/projected/b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea-kube-api-access-j46c4\") pod \"maas-api-5f9d6695cb-7ndtf\" (UID: \"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea\") " pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.694555 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.694529 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea-maas-api-tls\") pod \"maas-api-5f9d6695cb-7ndtf\" (UID: \"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea\") " pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.699870 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.699845 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46c4\" (UniqueName: \"kubernetes.io/projected/b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea-kube-api-access-j46c4\") pod \"maas-api-5f9d6695cb-7ndtf\" (UID: \"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea\") " pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.823267 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.823165 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:21.854041 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.853997 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-hmzg7"] May 21 17:44:21.857273 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.857252 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:21.859831 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.859788 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fjq9k\"" May 21 17:44:21.859961 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.859852 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 17:44:21.865942 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.865915 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-hmzg7"] May 21 17:44:21.894176 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.894123 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nvm7\" (UniqueName: \"kubernetes.io/projected/30b8dd03-125b-4078-96e7-8831d9a49d49-kube-api-access-4nvm7\") pod \"payload-processing-58b6c8fdc7-hmzg7\" (UID: \"30b8dd03-125b-4078-96e7-8831d9a49d49\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:21.960291 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.960259 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f9d6695cb-7ndtf"] May 21 17:44:21.962706 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:44:21.962672 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ece1e1_f1c9_4640_bef6_b1b1fd91aeea.slice/crio-4413d4315fcf812c2ed02ddb7373ffb37223aec3ebd61249d3cb34a94025b42a WatchSource:0}: Error finding container 4413d4315fcf812c2ed02ddb7373ffb37223aec3ebd61249d3cb34a94025b42a: Status 404 returned error can't find the container with id 4413d4315fcf812c2ed02ddb7373ffb37223aec3ebd61249d3cb34a94025b42a May 21 17:44:21.963953 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.963936 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 17:44:21.995200 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:21.995158 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nvm7\" (UniqueName: \"kubernetes.io/projected/30b8dd03-125b-4078-96e7-8831d9a49d49-kube-api-access-4nvm7\") pod \"payload-processing-58b6c8fdc7-hmzg7\" (UID: \"30b8dd03-125b-4078-96e7-8831d9a49d49\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:22.002731 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:22.002705 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nvm7\" (UniqueName: \"kubernetes.io/projected/30b8dd03-125b-4078-96e7-8831d9a49d49-kube-api-access-4nvm7\") pod \"payload-processing-58b6c8fdc7-hmzg7\" (UID: \"30b8dd03-125b-4078-96e7-8831d9a49d49\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:22.170939 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:22.170903 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:22.304771 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:22.304741 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-hmzg7"] May 21 17:44:22.304904 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:44:22.304855 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b8dd03_125b_4078_96e7_8831d9a49d49.slice/crio-9d44a7071fa6015a0080193a71aa6bbaa799699c276036594f35ef4b4e0baeb5 WatchSource:0}: Error finding container 9d44a7071fa6015a0080193a71aa6bbaa799699c276036594f35ef4b4e0baeb5: Status 404 returned error can't find the container with id 9d44a7071fa6015a0080193a71aa6bbaa799699c276036594f35ef4b4e0baeb5 May 21 17:44:22.534235 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:22.534140 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" event={"ID":"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea","Type":"ContainerStarted","Data":"4413d4315fcf812c2ed02ddb7373ffb37223aec3ebd61249d3cb34a94025b42a"} May 21 17:44:22.535203 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:22.535176 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" event={"ID":"30b8dd03-125b-4078-96e7-8831d9a49d49","Type":"ContainerStarted","Data":"9d44a7071fa6015a0080193a71aa6bbaa799699c276036594f35ef4b4e0baeb5"} May 21 17:44:24.544849 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:24.544786 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" event={"ID":"30b8dd03-125b-4078-96e7-8831d9a49d49","Type":"ContainerStarted","Data":"a0a8ae52df8101d0e8b7f2df73b1ba528155c808c2d6f083d9616d41ec3d2a9b"} May 21 17:44:24.545276 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:24.544861 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:24.546217 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:24.546193 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" event={"ID":"b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea","Type":"ContainerStarted","Data":"39ad19781f5d15c3ad7f4eed784d7e7f85b54041dacb9e567440ecf0436c8fc9"} May 21 17:44:24.546332 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:24.546309 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:24.561194 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:24.561141 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" podStartSLOduration=1.910180786 podStartE2EDuration="3.561125263s" podCreationTimestamp="2026-05-21 17:44:21 +0000 UTC" firstStartedPulling="2026-05-21 17:44:22.307187245 +0000 UTC m=+713.740090933" lastFinishedPulling="2026-05-21 17:44:23.958131727 +0000 UTC m=+715.391035410" observedRunningTime="2026-05-21 17:44:24.559476422 +0000 UTC m=+715.992380123" watchObservedRunningTime="2026-05-21 17:44:24.561125263 +0000 UTC m=+715.994028963" May 21 17:44:24.573711 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:24.573657 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" podStartSLOduration=1.580955906 podStartE2EDuration="3.573641666s" podCreationTimestamp="2026-05-21 17:44:21 +0000 UTC" firstStartedPulling="2026-05-21 17:44:21.964058615 +0000 UTC m=+713.396962294" lastFinishedPulling="2026-05-21 17:44:23.956744374 +0000 UTC m=+715.389648054" observedRunningTime="2026-05-21 17:44:24.572883887 +0000 UTC m=+716.005787588" watchObservedRunningTime="2026-05-21 17:44:24.573641666 +0000 UTC m=+716.006545367" May 21 17:44:30.556425 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:30.556391 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5f9d6695cb-7ndtf" May 21 17:44:35.552790 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:35.552759 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-hmzg7" May 21 17:44:49.332933 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.332877 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx"] May 21 17:44:49.335498 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.335478 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.337982 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.337957 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dnpq5\"" May 21 17:44:49.338095 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.337957 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 17:44:49.338956 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.338938 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 17:44:49.339046 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.338965 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 17:44:49.345940 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.345919 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx"] May 21 17:44:49.442172 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.442142 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8095f5b-0e19-4544-824b-be9fb15edb95-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.442380 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.442182 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.442380 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.442247 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.442380 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.442275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.442380 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.442344 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4ss\" (UniqueName: \"kubernetes.io/projected/c8095f5b-0e19-4544-824b-be9fb15edb95-kube-api-access-wn4ss\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.442616 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.442383 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.543637 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.543597 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8095f5b-0e19-4544-824b-be9fb15edb95-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.543806 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.543669 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.543806 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.543716 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.543806 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.543741 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.543989 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.543808 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4ss\" (UniqueName: \"kubernetes.io/projected/c8095f5b-0e19-4544-824b-be9fb15edb95-kube-api-access-wn4ss\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.543989 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.543856 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.544398 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.544362 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.544398 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.544408 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.544562 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.544439 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.546057 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.546029 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8095f5b-0e19-4544-824b-be9fb15edb95-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.546270 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.546250 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8095f5b-0e19-4544-824b-be9fb15edb95-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.551025 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.551001 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4ss\" (UniqueName: \"kubernetes.io/projected/c8095f5b-0e19-4544-824b-be9fb15edb95-kube-api-access-wn4ss\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-7hskx\" (UID: \"c8095f5b-0e19-4544-824b-be9fb15edb95\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.645331 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.645303 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:44:49.786703 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:49.786663 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx"] May 21 17:44:49.792107 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:44:49.792072 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8095f5b_0e19_4544_824b_be9fb15edb95.slice/crio-b27a36965a0225b15e2e3f270137f0a4f267d839ea96c0a7aae39c7c0672c8b8 WatchSource:0}: Error finding container b27a36965a0225b15e2e3f270137f0a4f267d839ea96c0a7aae39c7c0672c8b8: Status 404 returned error can't find the container with id b27a36965a0225b15e2e3f270137f0a4f267d839ea96c0a7aae39c7c0672c8b8 May 21 17:44:50.649561 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:50.649521 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" event={"ID":"c8095f5b-0e19-4544-824b-be9fb15edb95","Type":"ContainerStarted","Data":"b27a36965a0225b15e2e3f270137f0a4f267d839ea96c0a7aae39c7c0672c8b8"} May 21 17:44:56.676889 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:44:56.676851 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" event={"ID":"c8095f5b-0e19-4544-824b-be9fb15edb95","Type":"ContainerStarted","Data":"ed522d0786d8762e2a0a74712e219920fd70dbc9825ffa46a45dc2edf5f3f7fa"} May 21 17:45:04.717266 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:04.717231 2551 generic.go:358] "Generic (PLEG): container finished" podID="c8095f5b-0e19-4544-824b-be9fb15edb95" containerID="ed522d0786d8762e2a0a74712e219920fd70dbc9825ffa46a45dc2edf5f3f7fa" exitCode=0 May 21 17:45:04.717653 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:04.717304 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" event={"ID":"c8095f5b-0e19-4544-824b-be9fb15edb95","Type":"ContainerDied","Data":"ed522d0786d8762e2a0a74712e219920fd70dbc9825ffa46a45dc2edf5f3f7fa"} May 21 17:45:05.630644 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.630607 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj"] May 21 17:45:05.633453 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.633428 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.636090 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.636065 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 17:45:05.645283 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.645229 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj"] May 21 17:45:05.686667 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.685475 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78927d96-5158-4f88-a74a-30410a7ad936-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.686667 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.685545 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rt7b\" (UniqueName: \"kubernetes.io/projected/78927d96-5158-4f88-a74a-30410a7ad936-kube-api-access-7rt7b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.686667 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.685598 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.686667 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.685669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.686667 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.685699 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.686667 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.685723 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.788841 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.787131 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rt7b\" (UniqueName: \"kubernetes.io/projected/78927d96-5158-4f88-a74a-30410a7ad936-kube-api-access-7rt7b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.788841 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.787189 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.788841 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.787253 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.788841 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.787282 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.788841 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.787309 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.788841 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.787361 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78927d96-5158-4f88-a74a-30410a7ad936-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.789530 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.789221 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.789530 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.789262 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.789747 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.789538 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.791161 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.791134 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78927d96-5158-4f88-a74a-30410a7ad936-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.791742 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.791715 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78927d96-5158-4f88-a74a-30410a7ad936-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.796171 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.796141 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rt7b\" (UniqueName: \"kubernetes.io/projected/78927d96-5158-4f88-a74a-30410a7ad936-kube-api-access-7rt7b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj\" (UID: \"78927d96-5158-4f88-a74a-30410a7ad936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:05.948700 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:05.948659 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:06.181288 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:06.181262 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj"] May 21 17:45:06.726905 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:06.726867 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" event={"ID":"c8095f5b-0e19-4544-824b-be9fb15edb95","Type":"ContainerStarted","Data":"d2bb4e426ce9a4334a7ed2eca989ba275c72ab857a48c7203c4352018979d210"} May 21 17:45:06.727206 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:06.727067 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:45:06.728234 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:06.728194 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" event={"ID":"78927d96-5158-4f88-a74a-30410a7ad936","Type":"ContainerStarted","Data":"257fa97902cb22bf36dec17e20eb7c224bc8239d207e5699a543db4420dc9063"} May 21 17:45:06.728234 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:06.728231 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" event={"ID":"78927d96-5158-4f88-a74a-30410a7ad936","Type":"ContainerStarted","Data":"8498af44065593fe866dce4e474e61b7550b5f5900c881f8247deba944d9a178"} May 21 17:45:06.744349 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:06.744299 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" podStartSLOduration=1.464266789 podStartE2EDuration="17.744285848s" podCreationTimestamp="2026-05-21 17:44:49 +0000 UTC" firstStartedPulling="2026-05-21 17:44:49.793916555 +0000 UTC m=+741.226820235" lastFinishedPulling="2026-05-21 17:45:06.073935608 +0000 UTC m=+757.506839294" observedRunningTime="2026-05-21 17:45:06.742269254 +0000 UTC m=+758.175172978" watchObservedRunningTime="2026-05-21 17:45:06.744285848 +0000 UTC m=+758.177189549" May 21 17:45:12.751866 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:12.751806 2551 generic.go:358] "Generic (PLEG): container finished" podID="78927d96-5158-4f88-a74a-30410a7ad936" containerID="257fa97902cb22bf36dec17e20eb7c224bc8239d207e5699a543db4420dc9063" exitCode=0 May 21 17:45:12.752250 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:12.751882 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" event={"ID":"78927d96-5158-4f88-a74a-30410a7ad936","Type":"ContainerDied","Data":"257fa97902cb22bf36dec17e20eb7c224bc8239d207e5699a543db4420dc9063"} May 21 17:45:13.757265 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:13.757231 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" event={"ID":"78927d96-5158-4f88-a74a-30410a7ad936","Type":"ContainerStarted","Data":"d8d75fda8204a03fd2cd1bebc0a046f20c26351b00c79c13a9443faef9a6de6c"} May 21 17:45:13.757652 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:13.757464 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:45:13.774676 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:13.774623 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" podStartSLOduration=8.295487791 podStartE2EDuration="8.774609542s" podCreationTimestamp="2026-05-21 17:45:05 +0000 UTC" firstStartedPulling="2026-05-21 17:45:12.752495676 +0000 UTC m=+764.185399354" lastFinishedPulling="2026-05-21 17:45:13.231617414 +0000 UTC m=+764.664521105" observedRunningTime="2026-05-21 17:45:13.772861689 +0000 UTC m=+765.205765392" watchObservedRunningTime="2026-05-21 17:45:13.774609542 +0000 UTC m=+765.207513242" May 21 17:45:17.745121 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:17.745091 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-7hskx" May 21 17:45:24.775366 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:45:24.775334 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj" May 21 17:47:05.779564 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:05.779526 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-k8lzr"] May 21 17:47:05.780379 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:05.780009 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" podUID="8d7767bb-8123-44a9-a07a-883344e2a6c9" containerName="manager" containerID="cri-o://3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36" gracePeriod=30 May 21 17:47:06.023515 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.023491 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:47:06.132002 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.131978 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bb4p\" (UniqueName: \"kubernetes.io/projected/8d7767bb-8123-44a9-a07a-883344e2a6c9-kube-api-access-9bb4p\") pod \"8d7767bb-8123-44a9-a07a-883344e2a6c9\" (UID: \"8d7767bb-8123-44a9-a07a-883344e2a6c9\") " May 21 17:47:06.134029 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.133997 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7767bb-8123-44a9-a07a-883344e2a6c9-kube-api-access-9bb4p" (OuterVolumeSpecName: "kube-api-access-9bb4p") pod "8d7767bb-8123-44a9-a07a-883344e2a6c9" (UID: "8d7767bb-8123-44a9-a07a-883344e2a6c9"). InnerVolumeSpecName "kube-api-access-9bb4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 17:47:06.201102 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.201064 2551 generic.go:358] "Generic (PLEG): container finished" podID="8d7767bb-8123-44a9-a07a-883344e2a6c9" containerID="3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36" exitCode=0 May 21 17:47:06.201275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.201127 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" May 21 17:47:06.201275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.201150 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" event={"ID":"8d7767bb-8123-44a9-a07a-883344e2a6c9","Type":"ContainerDied","Data":"3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36"} May 21 17:47:06.201275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.201190 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69dccd4bd-k8lzr" event={"ID":"8d7767bb-8123-44a9-a07a-883344e2a6c9","Type":"ContainerDied","Data":"576312943cde3a013d9399d53734e1744f695570833a6329b2f4de7bc17e9cb2"} May 21 17:47:06.201275 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.201213 2551 scope.go:117] "RemoveContainer" containerID="3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36" May 21 17:47:06.210518 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.210500 2551 scope.go:117] "RemoveContainer" containerID="3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36" May 21 17:47:06.210776 ip-10-0-130-70 kubenswrapper[2551]: E0521 17:47:06.210758 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36\": container with ID starting with 3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36 not found: ID does not exist" containerID="3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36" May 21 17:47:06.210840 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.210793 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36"} err="failed to get container status \"3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36\": rpc error: code = NotFound desc = could not find container \"3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36\": container with ID starting with 3b584baf4ad5af6157f1acfbf74f19a5061078d2c9bd47af2a7c39dfd902ab36 not found: ID does not exist" May 21 17:47:06.222365 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.222325 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-k8lzr"] May 21 17:47:06.225038 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.225016 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-k8lzr"] May 21 17:47:06.232896 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:06.232877 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bb4p\" (UniqueName: \"kubernetes.io/projected/8d7767bb-8123-44a9-a07a-883344e2a6c9-kube-api-access-9bb4p\") on node \"ip-10-0-130-70.ec2.internal\" DevicePath \"\"" May 21 17:47:07.017664 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.017628 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69dccd4bd-6z4zb"] May 21 17:47:07.018073 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.018027 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7767bb-8123-44a9-a07a-883344e2a6c9" containerName="manager" May 21 17:47:07.018073 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.018040 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7767bb-8123-44a9-a07a-883344e2a6c9" containerName="manager" May 21 17:47:07.018143 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.018106 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7767bb-8123-44a9-a07a-883344e2a6c9" containerName="manager" May 21 17:47:07.021055 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.021040 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:07.023354 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.023331 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l7lfd\"" May 21 17:47:07.029243 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.029223 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-6z4zb"] May 21 17:47:07.136298 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.136269 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d7767bb-8123-44a9-a07a-883344e2a6c9" path="/var/lib/kubelet/pods/8d7767bb-8123-44a9-a07a-883344e2a6c9/volumes" May 21 17:47:07.140883 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.140864 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6f6\" (UniqueName: \"kubernetes.io/projected/919d3698-c4a5-4fe3-b8b1-3807906163c9-kube-api-access-gf6f6\") pod \"maas-controller-69dccd4bd-6z4zb\" (UID: \"919d3698-c4a5-4fe3-b8b1-3807906163c9\") " pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:07.242176 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.242140 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6f6\" (UniqueName: \"kubernetes.io/projected/919d3698-c4a5-4fe3-b8b1-3807906163c9-kube-api-access-gf6f6\") pod \"maas-controller-69dccd4bd-6z4zb\" (UID: \"919d3698-c4a5-4fe3-b8b1-3807906163c9\") " pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:07.250889 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.250862 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6f6\" (UniqueName: \"kubernetes.io/projected/919d3698-c4a5-4fe3-b8b1-3807906163c9-kube-api-access-gf6f6\") pod \"maas-controller-69dccd4bd-6z4zb\" (UID: \"919d3698-c4a5-4fe3-b8b1-3807906163c9\") " pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:07.331924 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.331839 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:07.454098 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:07.454075 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69dccd4bd-6z4zb"] May 21 17:47:07.455717 ip-10-0-130-70 kubenswrapper[2551]: W0521 17:47:07.455695 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919d3698_c4a5_4fe3_b8b1_3807906163c9.slice/crio-07c22641a92be35c226602c5d8239641f88b049394ce66b8f45bbc72092eb34a WatchSource:0}: Error finding container 07c22641a92be35c226602c5d8239641f88b049394ce66b8f45bbc72092eb34a: Status 404 returned error can't find the container with id 07c22641a92be35c226602c5d8239641f88b049394ce66b8f45bbc72092eb34a May 21 17:47:08.211364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:08.211331 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" event={"ID":"919d3698-c4a5-4fe3-b8b1-3807906163c9","Type":"ContainerStarted","Data":"306faf9f7fbf68e3e0454f00661c198a8017fe5f78179e3ab1a9b69cf64ad36b"} May 21 17:47:08.211364 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:08.211365 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" event={"ID":"919d3698-c4a5-4fe3-b8b1-3807906163c9","Type":"ContainerStarted","Data":"07c22641a92be35c226602c5d8239641f88b049394ce66b8f45bbc72092eb34a"} May 21 17:47:08.211790 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:08.211448 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:08.227579 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:08.227530 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" podStartSLOduration=0.621667336 podStartE2EDuration="1.22751731s" podCreationTimestamp="2026-05-21 17:47:07 +0000 UTC" firstStartedPulling="2026-05-21 17:47:07.457301202 +0000 UTC m=+878.890204883" lastFinishedPulling="2026-05-21 17:47:08.063151171 +0000 UTC m=+879.496054857" observedRunningTime="2026-05-21 17:47:08.226548994 +0000 UTC m=+879.659452695" watchObservedRunningTime="2026-05-21 17:47:08.22751731 +0000 UTC m=+879.660421040" May 21 17:47:19.220604 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:19.220568 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69dccd4bd-6z4zb" May 21 17:47:29.158497 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:29.158470 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:47:29.159426 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:47:29.159404 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:52:29.187630 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:52:29.187554 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:52:29.193037 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:52:29.193016 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:57:29.220516 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:57:29.220488 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 17:57:29.225885 ip-10-0-130-70 kubenswrapper[2551]: I0521 17:57:29.225866 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 18:02:29.256494 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:02:29.256387 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 18:02:29.262564 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:02:29.262542 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 18:07:29.286997 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:07:29.286887 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 18:07:29.297614 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:07:29.297586 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lbkh6_7a5e40f2-455c-4af0-8502-308ebf85320e/ovn-acl-logging/0.log" May 21 18:08:20.003909 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:20.003810 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-zzknx_9780793a-7a26-4b89-8e25-6e98a332d457/manager/0.log" May 21 18:08:20.127780 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:20.127738 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f9d6695cb-7ndtf_b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea/maas-api/0.log" May 21 18:08:20.488046 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:20.488010 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69dccd4bd-6z4zb_919d3698-c4a5-4fe3-b8b1-3807906163c9/manager/0.log" May 21 18:08:20.607103 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:20.607071 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-kllqn_be876397-6267-4bbb-87c8-13d7fa9e4a94/manager/1.log" May 21 18:08:20.724867 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:20.724834 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7_f5f27544-8fcc-4c7a-8d5f-a584244ab638/manager/0.log" May 21 18:08:21.075069 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.075036 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-dm7ff_325e7a04-b6ad-46c4-9b21-04e208f1f5e2/postgres/0.log" May 21 18:08:21.841569 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.841528 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r_a30553fe-c75c-44d7-8040-aad05f741726/pull/0.log" May 21 18:08:21.847707 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.847682 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r_a30553fe-c75c-44d7-8040-aad05f741726/extract/0.log" May 21 18:08:21.853252 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.853231 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r_a30553fe-c75c-44d7-8040-aad05f741726/util/0.log" May 21 18:08:21.965986 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.965956 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg_4533ba26-c18b-4046-bd69-c602a55400f7/util/0.log" May 21 18:08:21.971995 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.971972 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg_4533ba26-c18b-4046-bd69-c602a55400f7/pull/0.log" May 21 18:08:21.977836 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:21.977793 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg_4533ba26-c18b-4046-bd69-c602a55400f7/extract/0.log" May 21 18:08:22.096038 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.095963 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x_0b859a49-6aba-4c81-b8f2-aa3840c20e42/util/0.log" May 21 18:08:22.102338 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.102311 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x_0b859a49-6aba-4c81-b8f2-aa3840c20e42/pull/0.log" May 21 18:08:22.108513 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.108491 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x_0b859a49-6aba-4c81-b8f2-aa3840c20e42/extract/0.log" May 21 18:08:22.219106 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.219080 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w_2499ae98-2e0a-4229-9d3c-d21c2a789d44/util/0.log" May 21 18:08:22.225868 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.225847 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w_2499ae98-2e0a-4229-9d3c-d21c2a789d44/pull/0.log" May 21 18:08:22.231713 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.231695 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w_2499ae98-2e0a-4229-9d3c-d21c2a789d44/extract/0.log" May 21 18:08:22.466637 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:22.466586 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-kk2bn_a6e2e100-a04e-4e96-a1a3-ad779c996a9f/manager/0.log" May 21 18:08:23.660875 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:23.660840 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-q8ppn_ddf4c4d8-641e-4c1c-9c78-5a270a514836/discovery/0.log" May 21 18:08:23.897873 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:23.897840 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85f6f977d9-dw4qf_c37d5109-2f68-4b4f-83c9-a27652f2bfca/kube-auth-proxy/0.log" May 21 18:08:24.022109 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:24.022017 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-g45hc_be5fabf0-fcee-41bb-8047-25fcb1b913e7/istio-proxy/0.log" May 21 18:08:24.154606 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:24.154541 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-hmzg7_30b8dd03-125b-4078-96e7-8831d9a49d49/payload-processing/0.log" May 21 18:08:24.971962 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:24.971920 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj_78927d96-5158-4f88-a74a-30410a7ad936/storage-initializer/0.log" May 21 18:08:24.979267 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:24.979242 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccwqrcj_78927d96-5158-4f88-a74a-30410a7ad936/main/0.log" May 21 18:08:25.213588 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:25.213544 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-7hskx_c8095f5b-0e19-4544-824b-be9fb15edb95/storage-initializer/0.log" May 21 18:08:25.221562 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:25.221533 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-7hskx_c8095f5b-0e19-4544-824b-be9fb15edb95/main/0.log" May 21 18:08:32.334341 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:32.334310 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kftnl_f8d9b829-b7c1-470b-a0a2-e3464bf3162c/global-pull-secret-syncer/0.log" May 21 18:08:32.545078 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:32.545050 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sfnqb_62de6571-701b-4a0c-b546-1fe6324912e0/konnectivity-agent/0.log" May 21 18:08:32.567411 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:32.567384 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-70.ec2.internal_e16bd74d5720cb60104d3ed68cf7a63c/haproxy/0.log" May 21 18:08:35.811426 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:35.811395 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r_a30553fe-c75c-44d7-8040-aad05f741726/extract/0.log" May 21 18:08:35.838595 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:35.838522 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r_a30553fe-c75c-44d7-8040-aad05f741726/util/0.log" May 21 18:08:35.880151 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:35.880120 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zkd7r_a30553fe-c75c-44d7-8040-aad05f741726/pull/0.log" May 21 18:08:35.922550 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:35.922523 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg_4533ba26-c18b-4046-bd69-c602a55400f7/extract/0.log" May 21 18:08:35.949032 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:35.948996 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg_4533ba26-c18b-4046-bd69-c602a55400f7/util/0.log" May 21 18:08:35.976182 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:35.976154 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07zfhg_4533ba26-c18b-4046-bd69-c602a55400f7/pull/0.log" May 21 18:08:36.011762 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.011737 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x_0b859a49-6aba-4c81-b8f2-aa3840c20e42/extract/0.log" May 21 18:08:36.043657 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.043626 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x_0b859a49-6aba-4c81-b8f2-aa3840c20e42/util/0.log" May 21 18:08:36.086787 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.086703 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9x_0b859a49-6aba-4c81-b8f2-aa3840c20e42/pull/0.log" May 21 18:08:36.126080 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.126055 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w_2499ae98-2e0a-4229-9d3c-d21c2a789d44/extract/0.log" May 21 18:08:36.156553 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.156523 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w_2499ae98-2e0a-4229-9d3c-d21c2a789d44/util/0.log" May 21 18:08:36.191094 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.191064 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kll9w_2499ae98-2e0a-4229-9d3c-d21c2a789d44/pull/0.log" May 21 18:08:36.565518 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:36.565485 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-kk2bn_a6e2e100-a04e-4e96-a1a3-ad779c996a9f/manager/0.log" May 21 18:08:38.950528 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:38.950494 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcfwr_15c1335c-5b84-42aa-87bc-7e6a162c821d/node-exporter/0.log" May 21 18:08:38.991232 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:38.991205 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcfwr_15c1335c-5b84-42aa-87bc-7e6a162c821d/kube-rbac-proxy/0.log" May 21 18:08:39.039338 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:39.039309 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcfwr_15c1335c-5b84-42aa-87bc-7e6a162c821d/init-textfile/0.log" May 21 18:08:41.019177 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.019140 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r"] May 21 18:08:41.022102 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.022083 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.026051 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.025859 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jnr\"/\"openshift-service-ca.crt\"" May 21 18:08:41.026051 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.026000 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5jnr\"/\"default-dockercfg-j7btw\"" May 21 18:08:41.026734 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.026716 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jnr\"/\"kube-root-ca.crt\"" May 21 18:08:41.038174 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.038150 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r"] May 21 18:08:41.139634 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.139602 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-proc\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.139854 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.139654 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr4bh\" (UniqueName: \"kubernetes.io/projected/96c4b2c6-6429-4b85-a248-f529736a4e3b-kube-api-access-lr4bh\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.139854 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.139735 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-sys\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.139854 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.139767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-lib-modules\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.139854 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.139797 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-podres\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.227696 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.227664 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-6tj6x_37e71e4d-df15-49c1-b256-3a1a0ec2f639/networking-console-plugin/0.log" May 21 18:08:41.240387 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240364 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-proc\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240479 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240418 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr4bh\" (UniqueName: \"kubernetes.io/projected/96c4b2c6-6429-4b85-a248-f529736a4e3b-kube-api-access-lr4bh\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240479 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240452 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-sys\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240479 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240467 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-lib-modules\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240592 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240481 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-proc\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240592 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240486 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-podres\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240592 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240550 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-sys\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240592 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240588 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-podres\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.240738 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.240599 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96c4b2c6-6429-4b85-a248-f529736a4e3b-lib-modules\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.250916 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.250889 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr4bh\" (UniqueName: \"kubernetes.io/projected/96c4b2c6-6429-4b85-a248-f529736a4e3b-kube-api-access-lr4bh\") pod \"perf-node-gather-daemonset-fsp8r\" (UID: \"96c4b2c6-6429-4b85-a248-f529736a4e3b\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.332648 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.332573 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:41.458501 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.458473 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r"] May 21 18:08:41.460340 ip-10-0-130-70 kubenswrapper[2551]: W0521 18:08:41.460310 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96c4b2c6_6429_4b85_a248_f529736a4e3b.slice/crio-7cadd15a342d2ba9ba886d25c179fa704452381f69b9623ad19b86c6c346d9f0 WatchSource:0}: Error finding container 7cadd15a342d2ba9ba886d25c179fa704452381f69b9623ad19b86c6c346d9f0: Status 404 returned error can't find the container with id 7cadd15a342d2ba9ba886d25c179fa704452381f69b9623ad19b86c6c346d9f0 May 21 18:08:41.461930 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:41.461911 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:08:42.119453 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:42.119418 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" event={"ID":"96c4b2c6-6429-4b85-a248-f529736a4e3b","Type":"ContainerStarted","Data":"a506ee7a5c44558597003d991ccfcb79afed7bb0f0ce6e02d97859d4651b61a4"} May 21 18:08:42.119453 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:42.119456 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" event={"ID":"96c4b2c6-6429-4b85-a248-f529736a4e3b","Type":"ContainerStarted","Data":"7cadd15a342d2ba9ba886d25c179fa704452381f69b9623ad19b86c6c346d9f0"} May 21 18:08:42.119956 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:42.119554 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:42.139093 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:42.139046 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" podStartSLOduration=1.139033078 podStartE2EDuration="1.139033078s" podCreationTimestamp="2026-05-21 18:08:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:08:42.136074373 +0000 UTC m=+2173.568978074" watchObservedRunningTime="2026-05-21 18:08:42.139033078 +0000 UTC m=+2173.571936778" May 21 18:08:43.716539 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:43.716492 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rk78k_176a8b84-1d81-4b38-8410-df549e2516e5/dns/0.log" May 21 18:08:43.737298 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:43.737250 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rk78k_176a8b84-1d81-4b38-8410-df549e2516e5/kube-rbac-proxy/0.log" May 21 18:08:43.856863 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:43.856814 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cgjpr_8e30383e-0967-4e33-9837-90aa0c04a17f/dns-node-resolver/0.log" May 21 18:08:44.375267 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:44.375242 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lj7vp_80c57e38-682f-414c-898e-a523f6587e1c/node-ca/0.log" May 21 18:08:45.444486 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:45.444448 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-q8ppn_ddf4c4d8-641e-4c1c-9c78-5a270a514836/discovery/0.log" May 21 18:08:45.499198 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:45.499168 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85f6f977d9-dw4qf_c37d5109-2f68-4b4f-83c9-a27652f2bfca/kube-auth-proxy/0.log" May 21 18:08:45.626849 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:45.626785 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-g45hc_be5fabf0-fcee-41bb-8047-25fcb1b913e7/istio-proxy/0.log" May 21 18:08:45.749086 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:45.748988 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-hmzg7_30b8dd03-125b-4078-96e7-8831d9a49d49/payload-processing/0.log" May 21 18:08:46.349932 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:46.349876 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-92v7g_db5d596d-cdb6-4684-90c8-7a0cd7cb9e0d/serve-healthcheck-canary/0.log" May 21 18:08:47.187151 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:47.187115 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ww8f9_1281f6fb-7e59-409f-8144-5d8f9aa8eab2/kube-rbac-proxy/0.log" May 21 18:08:47.213980 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:47.213954 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ww8f9_1281f6fb-7e59-409f-8144-5d8f9aa8eab2/exporter/0.log" May 21 18:08:47.241796 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:47.241754 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ww8f9_1281f6fb-7e59-409f-8144-5d8f9aa8eab2/extractor/0.log" May 21 18:08:48.133648 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:48.133621 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-fsp8r" May 21 18:08:49.443590 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.443559 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-zzknx_9780793a-7a26-4b89-8e25-6e98a332d457/manager/0.log" May 21 18:08:49.505093 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.505060 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f9d6695cb-7ndtf_b7ece1e1-f1c9-4640-bef6-b1b1fd91aeea/maas-api/0.log" May 21 18:08:49.689458 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.689375 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69dccd4bd-6z4zb_919d3698-c4a5-4fe3-b8b1-3807906163c9/manager/0.log" May 21 18:08:49.778500 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.778474 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-kllqn_be876397-6267-4bbb-87c8-13d7fa9e4a94/manager/0.log" May 21 18:08:49.796171 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.796145 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-kllqn_be876397-6267-4bbb-87c8-13d7fa9e4a94/manager/1.log" May 21 18:08:49.843324 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.843288 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9cddc7dd-5p9w7_f5f27544-8fcc-4c7a-8d5f-a584244ab638/manager/0.log" May 21 18:08:49.979500 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:49.979402 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-dm7ff_325e7a04-b6ad-46c4-9b21-04e208f1f5e2/postgres/0.log" May 21 18:08:51.474776 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:51.474742 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-z5r67_73667a64-2815-4e1a-baac-e7623c54a601/openshift-lws-operator/0.log" May 21 18:08:57.990787 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:57.990754 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/kube-multus-additional-cni-plugins/0.log" May 21 18:08:58.016390 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:58.016359 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/egress-router-binary-copy/0.log" May 21 18:08:58.038685 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:58.038660 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/cni-plugins/0.log" May 21 18:08:58.070293 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:58.070266 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/bond-cni-plugin/0.log" May 21 18:08:58.093749 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:58.093720 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/routeoverride-cni/0.log" May 21 18:08:58.115495 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:58.115465 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/whereabouts-cni-bincopy/0.log" May 21 18:08:58.137476 ip-10-0-130-70 kubenswrapper[2551]: I0521 18:08:58.137449 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2l49m_a5cb6771-fcb6-41db-8fc7-98a4a975a6fb/whereabouts-cni/0.log"