Jun 02 19:03:49.741015 ip-10-0-134-39 systemd[1]: Starting Kubernetes Kubelet... Jun 02 19:03:50.260286 ip-10-0-134-39 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:50.260286 ip-10-0-134-39 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 19:03:50.260286 ip-10-0-134-39 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:50.260286 ip-10-0-134-39 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 19:03:50.260286 ip-10-0-134-39 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:50.263515 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.263417 2582 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 19:03:50.270064 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270039 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:50.270064 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270060 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:50.270064 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270064 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:50.270064 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270068 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:50.270064 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270072 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270075 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270078 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270083 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270088 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270092 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270095 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270098 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270101 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270104 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270106 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270109 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270112 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270115 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270117 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270120 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270123 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270125 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270154 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270158 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:50.270266 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270161 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270164 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270167 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270170 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270174 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270176 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270179 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270182 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270184 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270187 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270189 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270192 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270194 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270197 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270201 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270204 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270206 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270209 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270212 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270214 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:50.270781 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270217 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270219 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270222 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270224 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270227 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270230 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270233 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270236 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270239 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270241 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270244 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270246 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270249 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270252 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270255 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270259 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270263 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270267 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270271 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270274 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:50.271273 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270276 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270279 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270282 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270284 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270288 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270290 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270294 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270297 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270299 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270302 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270305 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270307 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270310 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270313 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270317 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270325 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270330 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270333 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270335 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:50.271774 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270338 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270341 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270344 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270774 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270780 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270783 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270786 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270789 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270791 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270794 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270797 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270800 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270803 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270805 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270808 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270810 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270813 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270816 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270818 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270821 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:50.272233 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270824 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270826 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270829 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270832 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270834 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270837 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270840 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270843 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270846 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270849 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270851 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270854 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270856 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270859 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270862 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270864 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270868 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270872 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270875 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270878 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:50.272724 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270880 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270883 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270886 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270889 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270892 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270895 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270897 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270900 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270903 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270905 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270908 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270912 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270915 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270917 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270920 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270922 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270925 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270927 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270930 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:50.273220 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270932 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270936 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270939 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270941 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270944 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270946 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270949 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270952 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270955 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270957 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270960 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270962 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270965 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270967 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270970 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270973 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270975 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270978 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270980 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270983 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:50.273720 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270986 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270988 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270991 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270994 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270996 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.270999 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271002 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271005 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271007 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271010 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271087 2582 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271098 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271104 2582 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271108 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271121 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271125 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271133 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271137 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271141 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271144 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271147 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271150 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 19:03:50.274212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271153 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271157 2582 flags.go:64] FLAG: --cgroup-root="" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271159 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271162 2582 flags.go:64] FLAG: --client-ca-file="" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271168 2582 flags.go:64] FLAG: --cloud-config="" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271171 2582 flags.go:64] FLAG: --cloud-provider="external" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271174 2582 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271178 2582 flags.go:64] FLAG: --cluster-domain="" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271181 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271184 2582 flags.go:64] FLAG: --config-dir="" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271188 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271191 2582 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271195 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271198 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271201 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271204 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271207 2582 flags.go:64] FLAG: --contention-profiling="false" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271210 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271213 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271217 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271220 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271226 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271229 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271231 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271234 2582 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 19:03:50.274765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271238 2582 flags.go:64] FLAG: --enable-server="true" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271241 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271245 2582 flags.go:64] FLAG: --event-burst="100" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271249 2582 flags.go:64] FLAG: --event-qps="50" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271251 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271254 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271257 2582 flags.go:64] FLAG: --eviction-hard="" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271261 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271264 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271266 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271269 2582 flags.go:64] FLAG: --eviction-soft="" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271274 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271277 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271280 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271283 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271286 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271289 2582 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271292 2582 flags.go:64] FLAG: --feature-gates="" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271296 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271299 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271302 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271305 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271309 2582 flags.go:64] FLAG: --healthz-port="10248" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271312 2582 flags.go:64] FLAG: --help="false" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271315 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.275408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271318 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271321 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271323 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271328 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271332 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271335 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271337 2582 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271340 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271343 2582 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271346 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271350 2582 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271352 2582 flags.go:64] FLAG: --kube-reserved="" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271355 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271358 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271361 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271364 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271366 2582 flags.go:64] FLAG: --lock-file="" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271369 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271373 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271376 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271381 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271384 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271387 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 19:03:50.276020 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271390 2582 flags.go:64] FLAG: --logging-format="text" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271393 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271396 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271399 2582 flags.go:64] FLAG: --manifest-url="" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271402 2582 flags.go:64] FLAG: --manifest-url-header="" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271406 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271409 2582 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271413 2582 flags.go:64] FLAG: --max-pods="110" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271416 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271419 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271421 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271424 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271428 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271431 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271434 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271441 2582 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271445 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271447 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271451 2582 flags.go:64] FLAG: --pod-cidr="" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271454 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271459 2582 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271462 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271465 2582 flags.go:64] FLAG: --pods-per-core="0" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271468 2582 flags.go:64] FLAG: --port="10250" Jun 02 19:03:50.276601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271471 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271474 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00a88d4191efc0103" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271477 2582 flags.go:64] FLAG: --qos-reserved="" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271480 2582 flags.go:64] FLAG: --read-only-port="10255" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271484 2582 flags.go:64] FLAG: --register-node="true" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271487 2582 flags.go:64] FLAG: --register-schedulable="true" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271490 2582 flags.go:64] FLAG: --register-with-taints="" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271494 2582 flags.go:64] FLAG: --registry-burst="10" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271497 2582 flags.go:64] FLAG: --registry-qps="5" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271499 2582 flags.go:64] FLAG: --reserved-cpus="" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271502 2582 flags.go:64] FLAG: --reserved-memory="" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271506 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271509 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271512 2582 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271515 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271518 2582 flags.go:64] FLAG: --runonce="false" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271520 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271523 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271526 2582 flags.go:64] FLAG: --seccomp-default="false" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271529 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271537 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271539 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271543 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271545 2582 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271548 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271551 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 19:03:50.277205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271554 2582 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271557 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271561 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271563 2582 flags.go:64] FLAG: --system-cgroups="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271566 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271571 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271574 2582 flags.go:64] FLAG: --tls-cert-file="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271577 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271582 2582 flags.go:64] FLAG: --tls-min-version="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271584 2582 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271588 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271591 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271594 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271597 2582 flags.go:64] FLAG: --v="2" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271601 2582 flags.go:64] FLAG: --version="false" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271604 2582 flags.go:64] FLAG: --vmodule="" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271609 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.271612 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271734 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271738 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271741 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271744 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271746 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:50.277826 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271749 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271752 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271755 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271759 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271761 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271764 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271767 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271769 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271772 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271774 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271777 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271781 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271783 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271786 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271789 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271791 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271794 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271797 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271799 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271802 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:50.278610 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271805 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271807 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271810 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271812 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271815 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271817 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271820 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271822 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271825 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271827 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271830 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271833 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271835 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271838 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271840 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271844 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271846 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271849 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271851 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271854 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:50.279488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271856 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271859 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271861 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271864 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271867 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271869 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271872 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271874 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271877 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271880 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271884 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271887 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271890 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271893 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271895 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271898 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271901 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271903 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271906 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:50.280380 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271909 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271912 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271914 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271917 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271919 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271922 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271924 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271927 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271930 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271933 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271936 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271938 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271941 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271945 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271948 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271952 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271954 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271957 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271960 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271962 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:50.281340 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271965 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.271967 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.272907 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.280163 2582 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.280187 2582 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280262 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280271 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280276 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280284 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280290 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280295 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280299 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280305 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280310 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280314 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:50.281890 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280318 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280323 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280327 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280331 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280335 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280339 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280344 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280348 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280353 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280358 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280362 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280367 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280371 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280376 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280379 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280383 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280387 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280391 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280395 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280399 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:50.282345 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280403 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280415 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280421 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280425 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280430 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280434 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280439 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280443 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280447 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280452 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280456 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280460 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280464 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280469 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280473 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280477 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280481 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280485 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280490 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280494 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:50.283047 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280498 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280502 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280506 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280510 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280514 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280518 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280521 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280525 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280529 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280533 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280536 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280540 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280543 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280548 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280553 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280557 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280561 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280565 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280569 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280573 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:50.283655 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280577 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280581 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280585 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280589 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280593 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280597 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280603 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280609 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280613 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280617 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280621 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280626 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280630 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280634 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280638 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:50.284201 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280643 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.280651 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280838 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280848 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280853 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280857 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280862 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280866 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280871 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280875 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280880 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280884 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280889 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280893 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280898 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280903 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:50.284581 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280907 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280912 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280917 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280923 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280927 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280931 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280935 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280939 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280943 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280948 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280952 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280957 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280961 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280966 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280970 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280974 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280978 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280983 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280987 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280992 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:50.285003 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.280996 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281001 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281005 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281009 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281013 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281018 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281022 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281026 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281030 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281039 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281044 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281048 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281055 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281060 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281065 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281069 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281074 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281078 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281083 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:50.285513 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281087 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281092 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281096 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281100 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281105 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281109 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281114 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281118 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281122 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281126 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281131 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281135 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281139 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281144 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281148 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281153 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281157 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281161 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281165 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281170 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:50.286013 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281174 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281178 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281182 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281187 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281191 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281195 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281199 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281203 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281207 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281211 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281215 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281219 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:50.281223 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.281231 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:50.286506 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.282132 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 19:03:50.288027 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.288009 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 19:03:50.290557 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.290543 2582 server.go:1019] "Starting client certificate rotation" Jun 02 19:03:50.290666 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.290646 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:50.290727 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.290702 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:50.318467 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.318435 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:50.322991 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.322971 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:50.333173 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.333146 2582 log.go:25] "Validated CRI v1 runtime API" Jun 02 19:03:50.339886 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.339862 2582 log.go:25] "Validated CRI v1 image API" Jun 02 19:03:50.344106 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.344086 2582 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 19:03:50.346970 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.346947 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8e640bc3-1304-4c60-b841-321492389920:/dev/nvme0n1p4 b06ff1bb-20a4-4d9c-8f53-0f1d33d3d6ff:/dev/nvme0n1p3] Jun 02 19:03:50.347050 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.346968 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 19:03:50.352092 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.351495 2582 manager.go:217] Machine: {Timestamp:2026-06-02 19:03:50.351003043 +0000 UTC m=+0.468806768 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099673 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec225500e59570539689065bc928ffa8 SystemUUID:ec225500-e595-7053-9689-065bc928ffa8 BootID:e53bbad4-3a4d-477a-9660-4b69a104750c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:68:63:60:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:68:63:60:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:b4:a4:e0:0a:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 19:03:50.352819 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.352808 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 19:03:50.352945 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.352934 2582 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 19:03:50.354151 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.354133 2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:50.356347 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.356323 2582 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 19:03:50.356491 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.356351 2582 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 19:03:50.356538 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.356500 2582 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 19:03:50.356538 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.356508 2582 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 19:03:50.356538 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.356517 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:50.357224 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.357212 2582 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:50.358223 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.358213 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:50.358519 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.358510 2582 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 19:03:50.361243 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.361232 2582 kubelet.go:491] "Attempting to sync node with API server" Jun 02 19:03:50.361283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.361248 2582 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 19:03:50.361283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.361261 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 19:03:50.361283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.361270 2582 kubelet.go:397] "Adding apiserver pod source" Jun 02 19:03:50.361283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.361280 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 19:03:50.362374 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.362361 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:50.362417 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.362381 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:50.365933 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.365912 2582 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 19:03:50.367939 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.367927 2582 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 19:03:50.369953 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.369928 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 19:03:50.370022 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.369983 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 19:03:50.370384 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370371 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370387 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370394 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370399 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370407 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370414 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370420 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370426 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370435 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370441 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370450 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 19:03:50.370452 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.370456 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 19:03:50.371188 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.371176 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 19:03:50.371221 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.371191 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 19:03:50.371258 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.371243 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-99lsr" Jun 02 19:03:50.374240 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.374225 2582 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 19:03:50.374297 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.374272 2582 server.go:1295] "Started kubelet" Jun 02 19:03:50.374383 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.374345 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 19:03:50.375808 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.375753 2582 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 19:03:50.375890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.375835 2582 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 19:03:50.376434 ip-10-0-134-39 systemd[1]: Started Kubernetes Kubelet. Jun 02 19:03:50.377598 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.377034 2582 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 19:03:50.379158 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.379141 2582 server.go:317] "Adding debug handlers to kubelet server" Jun 02 19:03:50.382817 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.382792 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-99lsr" Jun 02 19:03:50.382987 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.382964 2582 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 19:03:50.383458 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383439 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 19:03:50.383537 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383474 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:50.383537 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383497 2582 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 19:03:50.383537 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383509 2582 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 19:03:50.383673 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383602 2582 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 19:03:50.383673 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383650 2582 reconstruct.go:97] "Volume reconstruction finished" Jun 02 19:03:50.383673 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.383657 2582 reconciler.go:26] "Reconciler: start to sync state" Jun 02 19:03:50.384448 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.384431 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.384899 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.384884 2582 factory.go:55] Registering systemd factory Jun 02 19:03:50.384899 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.384901 2582 factory.go:223] Registration of the systemd container factory successfully Jun 02 19:03:50.385083 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.385071 2582 factory.go:153] Registering CRI-O factory Jun 02 19:03:50.385083 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.385084 2582 factory.go:223] Registration of the crio container factory successfully Jun 02 19:03:50.385181 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.385169 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 19:03:50.385216 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.385192 2582 factory.go:103] Registering Raw factory Jun 02 19:03:50.385216 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.385204 2582 manager.go:1196] Started watching for new ooms in manager Jun 02 19:03:50.385562 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.385545 2582 manager.go:319] Starting recovery of all containers Jun 02 19:03:50.387980 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.387921 2582 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 19:03:50.393283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.393260 2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:50.394782 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.394765 2582 manager.go:324] Recovery completed Jun 02 19:03:50.395026 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.395007 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.399682 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.399567 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:50.401626 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.401601 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:50.401684 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.401633 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:50.401684 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.401644 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:50.402209 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.402192 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 19:03:50.402209 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.402207 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 19:03:50.402354 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.402227 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:50.405160 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.405146 2582 policy_none.go:49] "None policy: Start" Jun 02 19:03:50.405253 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.405167 2582 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 19:03:50.405253 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.405181 2582 state_mem.go:35] "Initializing new in-memory state store" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450025 2582 manager.go:341] "Starting Device Plugin manager" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.450104 2582 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450114 2582 server.go:85] "Starting device plugin registration server" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450340 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450349 2582 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450451 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450550 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.450558 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.451042 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 19:03:50.458679 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.451077 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.479911 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.479878 2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 19:03:50.481069 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.481053 2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 19:03:50.481123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.481083 2582 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 19:03:50.481123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.481102 2582 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 19:03:50.481123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.481110 2582 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 19:03:50.481251 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.481149 2582 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 19:03:50.484803 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.484784 2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:50.551218 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.551140 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:50.552283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.552265 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:50.552388 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.552298 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:50.552388 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.552311 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:50.552388 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.552343 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.560917 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.560901 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.561000 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.560923 2582 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-39.ec2.internal\": node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.571965 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.571941 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.582054 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.582018 2582 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal"] Jun 02 19:03:50.582148 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.582098 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:50.583013 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.582998 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:50.583100 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.583031 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:50.583100 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.583046 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:50.584797 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.584781 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:50.584975 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.584961 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.585021 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.584992 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:50.585495 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.585480 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:50.585572 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.585482 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:50.585572 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.585534 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:50.585572 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.585551 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:50.585572 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.585508 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:50.585777 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.585578 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:50.587025 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.587011 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.587076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.587041 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:50.587804 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.587764 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:50.587804 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.587796 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:50.587916 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.587810 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:50.608348 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.608332 2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.612567 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.612549 2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.672522 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.672494 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.685058 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.685034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5ac8fd51b5a69aa8af30d8cf4d35c5a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"a5ac8fd51b5a69aa8af30d8cf4d35c5a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.685117 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.685062 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ac8fd51b5a69aa8af30d8cf4d35c5a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"a5ac8fd51b5a69aa8af30d8cf4d35c5a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.685117 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.685081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc70752037b9bb415bdf82e94ddddd38-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"bc70752037b9bb415bdf82e94ddddd38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.773401 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.773355 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.785663 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.785638 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ac8fd51b5a69aa8af30d8cf4d35c5a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"a5ac8fd51b5a69aa8af30d8cf4d35c5a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.785730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.785670 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc70752037b9bb415bdf82e94ddddd38-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"bc70752037b9bb415bdf82e94ddddd38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.785730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.785686 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5ac8fd51b5a69aa8af30d8cf4d35c5a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"a5ac8fd51b5a69aa8af30d8cf4d35c5a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.785796 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.785753 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5ac8fd51b5a69aa8af30d8cf4d35c5a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"a5ac8fd51b5a69aa8af30d8cf4d35c5a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.785796 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.785767 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc70752037b9bb415bdf82e94ddddd38-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"bc70752037b9bb415bdf82e94ddddd38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.785796 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.785753 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ac8fd51b5a69aa8af30d8cf4d35c5a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"a5ac8fd51b5a69aa8af30d8cf4d35c5a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.874126 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.874065 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:50.910529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.910507 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.916105 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:50.916087 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jun 02 19:03:50.975093 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:50.975055 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:51.075537 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:51.075509 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:51.176049 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:51.175964 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:51.276469 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:51.276434 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:51.289833 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.289805 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 19:03:51.290012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.289944 2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:03:51.290012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.289947 2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:03:51.377436 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:51.377396 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jun 02 19:03:51.383576 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.383554 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:51.385279 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.385253 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:58:50 +0000 UTC" deadline="2028-02-27 08:47:45.2455991 +0000 UTC" Jun 02 19:03:51.385279 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.385276 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15229h43m53.860325352s" Jun 02 19:03:51.400990 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.400972 2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:51.408590 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:51.408562 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ac8fd51b5a69aa8af30d8cf4d35c5a.slice/crio-38733bbc55db643ba5911e442bb6815a59b5b39c6d2ff65af4de18583288785c WatchSource:0}: Error finding container 38733bbc55db643ba5911e442bb6815a59b5b39c6d2ff65af4de18583288785c: Status 404 returned error can't find the container with id 38733bbc55db643ba5911e442bb6815a59b5b39c6d2ff65af4de18583288785c Jun 02 19:03:51.408795 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:51.408770 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc70752037b9bb415bdf82e94ddddd38.slice/crio-4bb394a1d7edf508ad07227f5fd093168733c9a9487d88bf5f97e87f4f83f8a1 WatchSource:0}: Error finding container 4bb394a1d7edf508ad07227f5fd093168733c9a9487d88bf5f97e87f4f83f8a1: Status 404 returned error can't find the container with id 4bb394a1d7edf508ad07227f5fd093168733c9a9487d88bf5f97e87f4f83f8a1 Jun 02 19:03:51.412043 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.412027 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:03:51.431167 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.431105 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k2gjv" Jun 02 19:03:51.438439 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.438422 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k2gjv" Jun 02 19:03:51.458510 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.458473 2582 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:51.483858 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.483837 2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jun 02 19:03:51.484622 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.484579 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" event={"ID":"bc70752037b9bb415bdf82e94ddddd38","Type":"ContainerStarted","Data":"4bb394a1d7edf508ad07227f5fd093168733c9a9487d88bf5f97e87f4f83f8a1"} Jun 02 19:03:51.485500 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.485476 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"a5ac8fd51b5a69aa8af30d8cf4d35c5a","Type":"ContainerStarted","Data":"38733bbc55db643ba5911e442bb6815a59b5b39c6d2ff65af4de18583288785c"} Jun 02 19:03:51.495727 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.495705 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:51.497998 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.497986 2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jun 02 19:03:51.507329 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.507315 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:51.884881 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:51.884787 2582 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:52.144580 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.144443 2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:52.362789 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.362751 2582 apiserver.go:52] "Watching apiserver" Jun 02 19:03:52.372199 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.372165 2582 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 19:03:52.375224 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.375195 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-s9rb9","openshift-dns/node-resolver-sx9b5","openshift-image-registry/node-ca-jjv7r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal","openshift-multus/multus-drvmn","openshift-multus/network-metrics-daemon-9h44x","openshift-network-diagnostics/network-check-target-9kp8b","openshift-network-operator/iptables-alerter-998rf","kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2","openshift-cluster-node-tuning-operator/tuned-xd4qd","openshift-multus/multus-additional-cni-plugins-2skj9","openshift-ovn-kubernetes/ovnkube-node-lfttw"] Jun 02 19:03:52.376935 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.376892 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.378414 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.378394 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.379495 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.379473 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 19:03:52.379584 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.379507 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cksjb\"" Jun 02 19:03:52.379947 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.379890 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.379947 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.379944 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.380103 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.380054 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.380955 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.380899 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.381396 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.381371 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.381494 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.381377 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x2nh6\"" Jun 02 19:03:52.382147 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.382128 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 19:03:52.382245 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.382180 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rn5j8\"" Jun 02 19:03:52.382420 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.382402 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.382644 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.382626 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.384337 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.384316 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.384467 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.384449 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:52.384586 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.384545 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:03:52.386181 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.385907 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:52.386181 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.385964 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:03:52.386603 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.386566 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 19:03:52.386757 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.386712 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.386853 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.386761 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vd2ql\"" Jun 02 19:03:52.386935 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.386916 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 19:03:52.387043 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.386976 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.387373 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.387352 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.389178 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.388977 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.389892 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.389876 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.389974 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.389892 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.390269 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.390249 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 19:03:52.390368 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.390354 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d5km9\"" Jun 02 19:03:52.390833 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.390814 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.392227 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.392207 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 19:03:52.392558 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.392542 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 19:03:52.394319 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.393661 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lw2pg\"" Jun 02 19:03:52.394319 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.393807 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.395137 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395089 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.395271 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-device-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.395369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-system-cni-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395338 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-multus-certs\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395456 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-etc-kubernetes\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395456 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-cni-bin\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395533 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-hostroot\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395751 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395578 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkklf\" (UniqueName: \"kubernetes.io/projected/3a839b66-3621-4f01-8a52-ce1a23d49318-kube-api-access-bkklf\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.395751 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-netns\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395751 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-socket-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.395929 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395768 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-registration-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.395929 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23da05f4-d931-4366-86fe-fc67ceeeaa98-cni-binary-copy\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.395929 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-etc-selinux\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.395929 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395906 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a839b66-3621-4f01-8a52-ce1a23d49318-host\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.396115 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395945 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-k8s-cni-cncf-io\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396115 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.395991 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-kubelet\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396115 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a839b66-3621-4f01-8a52-ce1a23d49318-serviceca\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.396235 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396148 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.396235 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396162 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-cni-multus\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396469 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtxb\" (UniqueName: \"kubernetes.io/projected/23da05f4-d931-4366-86fe-fc67ceeeaa98-kube-api-access-bqtxb\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396577 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.396649 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-sys-fs\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.396649 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38748609-4237-4055-92e5-748cfde31ac3-hosts-file\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.396766 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh8sn\" (UniqueName: \"kubernetes.io/projected/38748609-4237-4055-92e5-748cfde31ac3-kube-api-access-zh8sn\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.396828 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396790 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-cni-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396828 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-socket-dir-parent\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396932 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-conf-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.396932 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-daemon-config\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.397035 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.396968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn27q\" (UniqueName: \"kubernetes.io/projected/22490daf-1c4b-4e9c-85da-2c0b44a24e42-kube-api-access-gn27q\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.397035 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38748609-4237-4055-92e5-748cfde31ac3-tmp-dir\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.397142 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397047 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-cnibin\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.397142 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:52.397142 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c5m8\" (UniqueName: \"kubernetes.io/projected/f60ab9c9-dd63-42f3-927d-c54786d84726-kube-api-access-5c5m8\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:52.397296 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-os-release\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.397409 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397380 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gx4jp\"" Jun 02 19:03:52.397481 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397438 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 19:03:52.397527 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.397505 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 19:03:52.398170 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.398123 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rmtdt\"" Jun 02 19:03:52.398258 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.398202 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.403711 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.403571 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 19:03:52.403711 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.403593 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 19:03:52.403711 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.403580 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 19:03:52.404817 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.404794 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 19:03:52.407849 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.407831 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 19:03:52.407951 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.407872 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tsxxb\"" Jun 02 19:03:52.408024 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.408009 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 19:03:52.439150 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.439115 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:51 +0000 UTC" deadline="2028-01-11 21:47:56.829077699 +0000 UTC" Jun 02 19:03:52.439150 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.439151 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14114h44m4.38993097s" Jun 02 19:03:52.484498 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.484475 2582 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 19:03:52.497780 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497748 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-system-cni-dir\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.497780 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010d8cd5-c7d5-4c01-818f-32284bde3097-host-slash\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d54b6a72-108f-4b65-8683-3965d71ea404-agent-certs\") pod \"konnectivity-agent-s9rb9\" (UID: \"d54b6a72-108f-4b65-8683-3965d71ea404\") " pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysctl-conf\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497895 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497919 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38748609-4237-4055-92e5-748cfde31ac3-hosts-file\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497936 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh8sn\" (UniqueName: \"kubernetes.io/projected/38748609-4237-4055-92e5-748cfde31ac3-kube-api-access-zh8sn\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497952 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-socket-dir-parent\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.497987 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-daemon-config\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.498012 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498012 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38748609-4237-4055-92e5-748cfde31ac3-hosts-file\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498030 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498041 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498050 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-socket-dir-parent\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-systemd\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498084 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-cni-netd\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498109 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn27q\" (UniqueName: \"kubernetes.io/projected/22490daf-1c4b-4e9c-85da-2c0b44a24e42-kube-api-access-gn27q\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498133 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38748609-4237-4055-92e5-748cfde31ac3-tmp-dir\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498173 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498201 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-run\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498228 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8kzl\" (UniqueName: \"kubernetes.io/projected/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-kube-api-access-g8kzl\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498263 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498292 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-os-release\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.498297 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498316 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-sys\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.498384 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:52.998348394 +0000 UTC m=+3.116152121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498397 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-device-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.498434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498400 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-os-release\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498417 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-system-cni-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498429 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38748609-4237-4055-92e5-748cfde31ac3-tmp-dir\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498472 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-device-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498481 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-system-cni-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-env-overrides\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498540 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-cni-bin\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498556 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-hostroot\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498579 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-netns\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-os-release\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498604 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-cni-bin\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-kubernetes\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498611 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-daemon-config\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498619 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-hostroot\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498634 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23da05f4-d931-4366-86fe-fc67ceeeaa98-cni-binary-copy\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.499286 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498648 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-netns\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/010d8cd5-c7d5-4c01-818f-32284bde3097-iptables-alerter-script\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-tuned\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498854 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-k8s-cni-cncf-io\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498880 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-kubelet\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498907 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d54b6a72-108f-4b65-8683-3965d71ea404-konnectivity-ca\") pod \"konnectivity-agent-s9rb9\" (UID: \"d54b6a72-108f-4b65-8683-3965d71ea404\") " pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498924 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-k8s-cni-cncf-io\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysctl-d\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-kubelet\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-ovn\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.498997 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtxb\" (UniqueName: \"kubernetes.io/projected/23da05f4-d931-4366-86fe-fc67ceeeaa98-kube-api-access-bqtxb\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499076 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23da05f4-d931-4366-86fe-fc67ceeeaa98-cni-binary-copy\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cnibin\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-run-netns\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499126 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-etc-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499150 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-sys-fs\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.500076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499167 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-cni-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499181 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-conf-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499203 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5c5m8\" (UniqueName: \"kubernetes.io/projected/f60ab9c9-dd63-42f3-927d-c54786d84726-kube-api-access-5c5m8\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499210 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-sys-fs\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84n6r\" (UniqueName: \"kubernetes.io/projected/010d8cd5-c7d5-4c01-818f-32284bde3097-kube-api-access-84n6r\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499224 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-cni-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-lib-modules\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499253 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-multus-conf-dir\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499263 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-host\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499291 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-slash\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499313 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-cnibin\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499333 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499353 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-var-lib-kubelet\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499370 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-cnibin\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-tmp\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499419 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-systemd\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-ovnkube-config\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.500770 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-var-lib-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499493 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-run-ovn-kubernetes\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-cni-bin\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499556 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-multus-certs\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499582 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-etc-kubernetes\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499615 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-etc-kubernetes\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499616 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-run-multus-certs\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysconfig\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499663 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkklf\" (UniqueName: \"kubernetes.io/projected/3a839b66-3621-4f01-8a52-ce1a23d49318-kube-api-access-bkklf\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-kubelet\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-node-log\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a21450a-8569-4423-828d-c6d81dfefeef-ovn-node-metrics-cert\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499761 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-socket-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499785 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-registration-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspwg\" (UniqueName: \"kubernetes.io/projected/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-kube-api-access-qspwg\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499858 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-log-socket\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-registration-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.501430 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499903 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-socket-dir\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499900 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-ovnkube-script-lib\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499936 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-etc-selinux\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499963 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a839b66-3621-4f01-8a52-ce1a23d49318-host\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499970 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22490daf-1c4b-4e9c-85da-2c0b44a24e42-etc-selinux\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-modprobe-d\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.499998 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a839b66-3621-4f01-8a52-ce1a23d49318-host\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.500002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-systemd-units\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.500038 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdd9\" (UniqueName: \"kubernetes.io/projected/1a21450a-8569-4423-828d-c6d81dfefeef-kube-api-access-jtdd9\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.500056 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a839b66-3621-4f01-8a52-ce1a23d49318-serviceca\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.500071 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-cni-multus\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.500131 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/23da05f4-d931-4366-86fe-fc67ceeeaa98-host-var-lib-cni-multus\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.501938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.500369 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a839b66-3621-4f01-8a52-ce1a23d49318-serviceca\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.508570 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.508244 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 19:03:52.512546 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.512092 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtxb\" (UniqueName: \"kubernetes.io/projected/23da05f4-d931-4366-86fe-fc67ceeeaa98-kube-api-access-bqtxb\") pod \"multus-drvmn\" (UID: \"23da05f4-d931-4366-86fe-fc67ceeeaa98\") " pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.512546 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.512168 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c5m8\" (UniqueName: \"kubernetes.io/projected/f60ab9c9-dd63-42f3-927d-c54786d84726-kube-api-access-5c5m8\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:52.512546 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.512224 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn27q\" (UniqueName: \"kubernetes.io/projected/22490daf-1c4b-4e9c-85da-2c0b44a24e42-kube-api-access-gn27q\") pod \"aws-ebs-csi-driver-node-td7r2\" (UID: \"22490daf-1c4b-4e9c-85da-2c0b44a24e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.512546 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.512262 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh8sn\" (UniqueName: \"kubernetes.io/projected/38748609-4237-4055-92e5-748cfde31ac3-kube-api-access-zh8sn\") pod \"node-resolver-sx9b5\" (UID: \"38748609-4237-4055-92e5-748cfde31ac3\") " pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.514961 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.514937 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkklf\" (UniqueName: \"kubernetes.io/projected/3a839b66-3621-4f01-8a52-ce1a23d49318-kube-api-access-bkklf\") pod \"node-ca-jjv7r\" (UID: \"3a839b66-3621-4f01-8a52-ce1a23d49318\") " pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.580415 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.580383 2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:52.601310 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601279 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysconfig\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.601310 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601317 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-kubelet\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601335 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-node-log\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601356 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a21450a-8569-4423-828d-c6d81dfefeef-ovn-node-metrics-cert\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601385 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qspwg\" (UniqueName: \"kubernetes.io/projected/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-kube-api-access-qspwg\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601412 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-log-socket\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601414 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysconfig\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601415 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-kubelet\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601437 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-ovnkube-script-lib\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601436 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-node-log\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601463 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-modprobe-d\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601484 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-systemd-units\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601505 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-log-socket\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.601529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601507 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdd9\" (UniqueName: \"kubernetes.io/projected/1a21450a-8569-4423-828d-c6d81dfefeef-kube-api-access-jtdd9\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601554 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-system-cni-dir\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601584 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601610 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010d8cd5-c7d5-4c01-818f-32284bde3097-host-slash\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601633 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d54b6a72-108f-4b65-8683-3965d71ea404-agent-certs\") pod \"konnectivity-agent-s9rb9\" (UID: \"d54b6a72-108f-4b65-8683-3965d71ea404\") " pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601658 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysctl-conf\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601702 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601731 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-systemd\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601758 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-cni-netd\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601797 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-run\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601821 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8kzl\" (UniqueName: \"kubernetes.io/projected/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-kube-api-access-g8kzl\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601848 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601874 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-sys\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601901 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601927 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601954 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-env-overrides\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.601984 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-os-release\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602026 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602012 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-kubernetes\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602039 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/010d8cd5-c7d5-4c01-818f-32284bde3097-iptables-alerter-script\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602064 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-tuned\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602098 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d54b6a72-108f-4b65-8683-3965d71ea404-konnectivity-ca\") pod \"konnectivity-agent-s9rb9\" (UID: \"d54b6a72-108f-4b65-8683-3965d71ea404\") " pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602123 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysctl-d\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602148 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-ovn\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602179 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602205 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cnibin\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602229 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-run-netns\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602254 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-etc-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602285 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84n6r\" (UniqueName: \"kubernetes.io/projected/010d8cd5-c7d5-4c01-818f-32284bde3097-kube-api-access-84n6r\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602325 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-lib-modules\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602348 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-host\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602370 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-slash\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602371 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-ovnkube-script-lib\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602381 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-system-cni-dir\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602395 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.602844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602435 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-var-lib-kubelet\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602442 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-systemd-units\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602450 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cnibin\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602465 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-tmp\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602504 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-systemd\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-run-netns\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602527 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-ovnkube-config\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602556 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-modprobe-d\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602565 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-var-lib-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602595 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-run-ovn-kubernetes\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602624 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-cni-bin\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-cni-bin\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-env-overrides\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602764 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-etc-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602836 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-cni-netd\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-run\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602877 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010d8cd5-c7d5-4c01-818f-32284bde3097-host-slash\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602876 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.603583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysctl-d\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602981 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-sysctl-conf\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.602984 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603020 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-os-release\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603071 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-kubernetes\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603089 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-lib-modules\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603135 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-sys\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603136 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603147 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-var-lib-kubelet\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603182 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603215 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-ovn\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-var-lib-openvswitch\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603274 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-systemd\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603187 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-slash\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603323 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-host\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603363 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-run-systemd\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603221 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a21450a-8569-4423-828d-c6d81dfefeef-host-run-ovn-kubernetes\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.604351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603447 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.604969 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603605 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d54b6a72-108f-4b65-8683-3965d71ea404-konnectivity-ca\") pod \"konnectivity-agent-s9rb9\" (UID: \"d54b6a72-108f-4b65-8683-3965d71ea404\") " pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.604969 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603711 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.604969 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603794 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/010d8cd5-c7d5-4c01-818f-32284bde3097-iptables-alerter-script\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.604969 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.603858 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a21450a-8569-4423-828d-c6d81dfefeef-ovnkube-config\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.605820 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.605793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d54b6a72-108f-4b65-8683-3965d71ea404-agent-certs\") pod \"konnectivity-agent-s9rb9\" (UID: \"d54b6a72-108f-4b65-8683-3965d71ea404\") " pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.606352 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.606315 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-etc-tuned\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.606439 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.606415 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-tmp\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.607851 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.607829 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:52.607851 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.607853 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:52.608002 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.607866 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:52.608002 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:52.607926 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:53.107907285 +0000 UTC m=+3.225711009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:52.610167 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.610137 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspwg\" (UniqueName: \"kubernetes.io/projected/5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c-kube-api-access-qspwg\") pod \"multus-additional-cni-plugins-2skj9\" (UID: \"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c\") " pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.610384 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.610362 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8kzl\" (UniqueName: \"kubernetes.io/projected/7b592c7a-aab1-41d9-94b5-ac71cca8bb4f-kube-api-access-g8kzl\") pod \"tuned-xd4qd\" (UID: \"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f\") " pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.610781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.610756 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdd9\" (UniqueName: \"kubernetes.io/projected/1a21450a-8569-4423-828d-c6d81dfefeef-kube-api-access-jtdd9\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.611083 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.611061 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84n6r\" (UniqueName: \"kubernetes.io/projected/010d8cd5-c7d5-4c01-818f-32284bde3097-kube-api-access-84n6r\") pod \"iptables-alerter-998rf\" (UID: \"010d8cd5-c7d5-4c01-818f-32284bde3097\") " pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.613066 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.613048 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a21450a-8569-4423-828d-c6d81dfefeef-ovn-node-metrics-cert\") pod \"ovnkube-node-lfttw\" (UID: \"1a21450a-8569-4423-828d-c6d81dfefeef\") " pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.689834 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.689723 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" Jun 02 19:03:52.697572 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.697543 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sx9b5" Jun 02 19:03:52.708765 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.708741 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-998rf" Jun 02 19:03:52.712313 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.712293 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjv7r" Jun 02 19:03:52.718875 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.718857 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-drvmn" Jun 02 19:03:52.725440 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.725420 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:03:52.732007 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.731988 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" Jun 02 19:03:52.737566 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.737549 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2skj9" Jun 02 19:03:52.742221 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:52.742204 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:03:52.980913 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.980868 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a839b66_3621_4f01_8a52_ce1a23d49318.slice/crio-7e0baf1aa357987c32fc4da89c29d4bdc1c55772705bc6d98058368d11a4585a WatchSource:0}: Error finding container 7e0baf1aa357987c32fc4da89c29d4bdc1c55772705bc6d98058368d11a4585a: Status 404 returned error can't find the container with id 7e0baf1aa357987c32fc4da89c29d4bdc1c55772705bc6d98058368d11a4585a Jun 02 19:03:52.982470 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.982396 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010d8cd5_c7d5_4c01_818f_32284bde3097.slice/crio-fd5a3e1e234c421e065f7106c4c404941270175936310897a3e69e5acdec41e4 WatchSource:0}: Error finding container fd5a3e1e234c421e065f7106c4c404941270175936310897a3e69e5acdec41e4: Status 404 returned error can't find the container with id fd5a3e1e234c421e065f7106c4c404941270175936310897a3e69e5acdec41e4 Jun 02 19:03:52.983178 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.983140 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a21450a_8569_4423_828d_c6d81dfefeef.slice/crio-9451f5c9376477123672b0ea84967620102ba260a5dd19de8a30abfebe765c9f WatchSource:0}: Error finding container 9451f5c9376477123672b0ea84967620102ba260a5dd19de8a30abfebe765c9f: Status 404 returned error can't find the container with id 9451f5c9376477123672b0ea84967620102ba260a5dd19de8a30abfebe765c9f Jun 02 19:03:52.986223 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.986122 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38748609_4237_4055_92e5_748cfde31ac3.slice/crio-16a84b44ceb487c90764dde413fd3d17e1f2343026f2a9c799a701f48a1d8da5 WatchSource:0}: Error finding container 16a84b44ceb487c90764dde413fd3d17e1f2343026f2a9c799a701f48a1d8da5: Status 404 returned error can't find the container with id 16a84b44ceb487c90764dde413fd3d17e1f2343026f2a9c799a701f48a1d8da5 Jun 02 19:03:52.986942 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.986925 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22490daf_1c4b_4e9c_85da_2c0b44a24e42.slice/crio-b8cba2dd2ee71738973217ee5c521cb9ef1f219686b54de051e25da47f621f2a WatchSource:0}: Error finding container b8cba2dd2ee71738973217ee5c521cb9ef1f219686b54de051e25da47f621f2a: Status 404 returned error can't find the container with id b8cba2dd2ee71738973217ee5c521cb9ef1f219686b54de051e25da47f621f2a Jun 02 19:03:52.987682 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.987651 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b592c7a_aab1_41d9_94b5_ac71cca8bb4f.slice/crio-3a1aa230e122d5d9f4051cf16bad8ee789abd9b17fe04849d365f698ed1fa173 WatchSource:0}: Error finding container 3a1aa230e122d5d9f4051cf16bad8ee789abd9b17fe04849d365f698ed1fa173: Status 404 returned error can't find the container with id 3a1aa230e122d5d9f4051cf16bad8ee789abd9b17fe04849d365f698ed1fa173 Jun 02 19:03:52.988674 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.988633 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dca2a65_a9ed_4cdf_9100_7c591e3f2b4c.slice/crio-f2499f66f54d62083e4c18ea2ab2ea43f52cfa45feb801d71ec60813445df578 WatchSource:0}: Error finding container f2499f66f54d62083e4c18ea2ab2ea43f52cfa45feb801d71ec60813445df578: Status 404 returned error can't find the container with id f2499f66f54d62083e4c18ea2ab2ea43f52cfa45feb801d71ec60813445df578 Jun 02 19:03:52.989472 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.989453 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23da05f4_d931_4366_86fe_fc67ceeeaa98.slice/crio-42124e4efc68f3b28ab57b614eed66ce61c5ee20d2b65b29e645f001ff05e174 WatchSource:0}: Error finding container 42124e4efc68f3b28ab57b614eed66ce61c5ee20d2b65b29e645f001ff05e174: Status 404 returned error can't find the container with id 42124e4efc68f3b28ab57b614eed66ce61c5ee20d2b65b29e645f001ff05e174 Jun 02 19:03:52.991908 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:03:52.991884 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54b6a72_108f_4b65_8683_3965d71ea404.slice/crio-eb61f81535bf835163aa3cae2fc7c1c161a676035a48c73dd92ff9f3243e76ff WatchSource:0}: Error finding container eb61f81535bf835163aa3cae2fc7c1c161a676035a48c73dd92ff9f3243e76ff: Status 404 returned error can't find the container with id eb61f81535bf835163aa3cae2fc7c1c161a676035a48c73dd92ff9f3243e76ff Jun 02 19:03:53.006361 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.006336 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:53.006472 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:53.006456 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:53.006545 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:53.006539 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.00652417 +0000 UTC m=+4.124327882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:53.207202 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.207171 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:53.207392 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:53.207303 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:53.207392 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:53.207329 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:53.207392 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:53.207342 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:53.207555 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:53.207404 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.207383936 +0000 UTC m=+4.325187657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:53.439759 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.439667 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:51 +0000 UTC" deadline="2028-01-25 20:40:08.662156234 +0000 UTC" Jun 02 19:03:53.439759 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.439722 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14449h36m15.222438138s" Jun 02 19:03:53.506739 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.506592 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerStarted","Data":"f2499f66f54d62083e4c18ea2ab2ea43f52cfa45feb801d71ec60813445df578"} Jun 02 19:03:53.519260 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.517923 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" event={"ID":"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f","Type":"ContainerStarted","Data":"3a1aa230e122d5d9f4051cf16bad8ee789abd9b17fe04849d365f698ed1fa173"} Jun 02 19:03:53.523705 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.523632 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" event={"ID":"22490daf-1c4b-4e9c-85da-2c0b44a24e42","Type":"ContainerStarted","Data":"b8cba2dd2ee71738973217ee5c521cb9ef1f219686b54de051e25da47f621f2a"} Jun 02 19:03:53.529408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.529352 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sx9b5" event={"ID":"38748609-4237-4055-92e5-748cfde31ac3","Type":"ContainerStarted","Data":"16a84b44ceb487c90764dde413fd3d17e1f2343026f2a9c799a701f48a1d8da5"} Jun 02 19:03:53.538658 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.538623 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" event={"ID":"bc70752037b9bb415bdf82e94ddddd38","Type":"ContainerStarted","Data":"3ec3c5773aa70ea42d24345fbe20368c8e1b798bd4825909b2744692fcea7351"} Jun 02 19:03:53.549031 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.549001 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"9451f5c9376477123672b0ea84967620102ba260a5dd19de8a30abfebe765c9f"} Jun 02 19:03:53.556314 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.555360 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" podStartSLOduration=2.555345748 podStartE2EDuration="2.555345748s" podCreationTimestamp="2026-06-02 19:03:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:53.555133829 +0000 UTC m=+3.672937564" watchObservedRunningTime="2026-06-02 19:03:53.555345748 +0000 UTC m=+3.673149482" Jun 02 19:03:53.561998 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.561944 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-998rf" event={"ID":"010d8cd5-c7d5-4c01-818f-32284bde3097","Type":"ContainerStarted","Data":"fd5a3e1e234c421e065f7106c4c404941270175936310897a3e69e5acdec41e4"} Jun 02 19:03:53.571935 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.571862 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjv7r" event={"ID":"3a839b66-3621-4f01-8a52-ce1a23d49318","Type":"ContainerStarted","Data":"7e0baf1aa357987c32fc4da89c29d4bdc1c55772705bc6d98058368d11a4585a"} Jun 02 19:03:53.607794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.607260 2582 generic.go:358] "Generic (PLEG): container finished" podID="a5ac8fd51b5a69aa8af30d8cf4d35c5a" containerID="bf2ba9f7caacd682ca0eca517492c320b13508b96c8c20fe705b570e9b58f0c5" exitCode=0 Jun 02 19:03:53.607794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.607352 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"a5ac8fd51b5a69aa8af30d8cf4d35c5a","Type":"ContainerDied","Data":"bf2ba9f7caacd682ca0eca517492c320b13508b96c8c20fe705b570e9b58f0c5"} Jun 02 19:03:53.623037 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.622995 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s9rb9" event={"ID":"d54b6a72-108f-4b65-8683-3965d71ea404","Type":"ContainerStarted","Data":"eb61f81535bf835163aa3cae2fc7c1c161a676035a48c73dd92ff9f3243e76ff"} Jun 02 19:03:53.632406 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:53.632337 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-drvmn" event={"ID":"23da05f4-d931-4366-86fe-fc67ceeeaa98","Type":"ContainerStarted","Data":"42124e4efc68f3b28ab57b614eed66ce61c5ee20d2b65b29e645f001ff05e174"} Jun 02 19:03:54.012168 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:54.012126 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:54.012353 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.012306 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:54.012411 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.012371 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:56.012349972 +0000 UTC m=+6.130153689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:54.214390 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:54.213732 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:54.214390 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.213904 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:54.214390 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.213923 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:54.214390 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.213939 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:54.214390 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.214007 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:56.213989428 +0000 UTC m=+6.331793142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:54.484281 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:54.484200 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:54.484800 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.484324 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:03:54.484864 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:54.484797 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:54.484941 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:54.484916 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:03:54.654423 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:54.654387 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"a5ac8fd51b5a69aa8af30d8cf4d35c5a","Type":"ContainerStarted","Data":"447edf85799af01993b95169619de486abf0ba30d5f4971e1a284dd3c243dcea"} Jun 02 19:03:56.030985 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:56.030930 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:56.031452 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.031080 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:56.031452 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.031157 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:00.031127719 +0000 UTC m=+10.148931454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:56.231900 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:56.231853 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:56.232081 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.232062 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:56.232151 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.232083 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:56.232151 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.232097 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:56.232260 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.232156 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:00.232136187 +0000 UTC m=+10.349939905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:56.482476 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:56.482395 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:56.482645 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.482538 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:03:56.482817 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:56.482792 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:56.482939 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:56.482917 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:03:58.482236 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:58.482202 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:03:58.482726 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:58.482327 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:03:58.482796 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:03:58.482743 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:03:58.482882 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:03:58.482848 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:00.062998 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:00.062951 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:00.063530 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.063166 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:00.063530 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.063233 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:08.06321211 +0000 UTC m=+18.181015826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:00.265267 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:00.265229 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:00.265441 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.265405 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:04:00.265441 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.265433 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:04:00.265571 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.265447 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:00.265571 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.265506 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:08.265487627 +0000 UTC m=+18.383291342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:00.482626 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:00.482549 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:00.482801 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.482666 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:00.483089 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:00.483069 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:00.483200 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:00.483181 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:02.481778 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:02.481739 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:02.482204 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:02.481754 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:02.482204 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:02.481896 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:02.482204 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:02.481934 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:04.481680 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:04.481643 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:04.482161 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:04.481700 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:04.482161 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:04.481781 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:04.482161 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:04.481924 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:06.482218 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:06.482183 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:06.482665 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:06.482224 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:06.482665 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:06.482311 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:06.482665 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:06.482422 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:08.125656 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:08.125612 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:08.126135 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.125791 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:08.126135 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.125878 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:24.125855082 +0000 UTC m=+34.243658798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:08.326768 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:08.326718 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:08.327034 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.326907 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:04:08.327034 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.326938 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:04:08.327034 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.326952 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:08.327034 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.327019 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:24.326999946 +0000 UTC m=+34.444803660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:08.481563 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:08.481468 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:08.481734 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.481605 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:08.481734 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:08.481662 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:08.481851 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:08.481764 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:10.482419 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:10.482393 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:10.482774 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:10.482499 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:10.482774 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:10.482572 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:10.482774 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:10.482664 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:11.690283 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.689924 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjv7r" event={"ID":"3a839b66-3621-4f01-8a52-ce1a23d49318","Type":"ContainerStarted","Data":"9fc53ba2944ade746ad3c118641cb2654cc9077ab88a00ccbf34f46c6f9794f5"} Jun 02 19:04:11.691554 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.691516 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s9rb9" event={"ID":"d54b6a72-108f-4b65-8683-3965d71ea404","Type":"ContainerStarted","Data":"7ce82cb6b4916df69674db9ff8e4189282a9daed72709d4d3d0bfcbf6b5854c7"} Jun 02 19:04:11.692928 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.692905 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-drvmn" event={"ID":"23da05f4-d931-4366-86fe-fc67ceeeaa98","Type":"ContainerStarted","Data":"b2c4157e460af0cd4cbfe9fccdfe901d344674b98431ce8c2dd1ae0f88948e30"} Jun 02 19:04:11.694333 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.694309 2582 generic.go:358] "Generic (PLEG): container finished" podID="5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c" containerID="748c6302ffea824a3ade801170df9b60e4b9aea3a200a5d77f9499d39eb2f12a" exitCode=0 Jun 02 19:04:11.694412 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.694369 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerDied","Data":"748c6302ffea824a3ade801170df9b60e4b9aea3a200a5d77f9499d39eb2f12a"} Jun 02 19:04:11.695757 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.695723 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" event={"ID":"7b592c7a-aab1-41d9-94b5-ac71cca8bb4f","Type":"ContainerStarted","Data":"618b8c7c2ecebaed4e74d140186ea97a4d5ba85933135df84393807b27679fd0"} Jun 02 19:04:11.697121 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.697100 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" event={"ID":"22490daf-1c4b-4e9c-85da-2c0b44a24e42","Type":"ContainerStarted","Data":"4e322d95d9575388cd3b47203c6a69ca3a9a868abd7cef74896891e96427b8ee"} Jun 02 19:04:11.698337 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.698315 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sx9b5" event={"ID":"38748609-4237-4055-92e5-748cfde31ac3","Type":"ContainerStarted","Data":"827f5b98056faf3576b7d4ac4238026294d7f3af2c1f56060b63aa79401dd44b"} Jun 02 19:04:11.700499 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700480 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:04:11.700797 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700776 2582 generic.go:358] "Generic (PLEG): container finished" podID="1a21450a-8569-4423-828d-c6d81dfefeef" containerID="c7cf19a4ff9abc6f46115d0b786f47d9812c8db842dacc0645501360d16f1861" exitCode=1 Jun 02 19:04:11.700877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700810 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"cf3135ef248b096278e62b7a04b90cf6bdf4a4aabc3c93a671515d433fe1a489"} Jun 02 19:04:11.700877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700827 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"f53bbfc4023d4baf9dbe567f08534fba284dd00db37e45940ed9250dadf472b4"} Jun 02 19:04:11.700877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700840 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"127c262cb530f6cb681fab820e351481f01cd7bf20542490070ab9dbc8c087c9"} Jun 02 19:04:11.700877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700852 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerDied","Data":"c7cf19a4ff9abc6f46115d0b786f47d9812c8db842dacc0645501360d16f1861"} Jun 02 19:04:11.700877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.700865 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"8e15957cb3bed7ae26f122bc7efaf0ba0f72e4a5fdf5106bd366f076e0145153"} Jun 02 19:04:11.705610 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.705528 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jjv7r" podStartSLOduration=3.879927161 podStartE2EDuration="21.705513988s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.982835135 +0000 UTC m=+3.100638867" lastFinishedPulling="2026-06-02 19:04:10.808421974 +0000 UTC m=+20.926225694" observedRunningTime="2026-06-02 19:04:11.704928049 +0000 UTC m=+21.822731784" watchObservedRunningTime="2026-06-02 19:04:11.705513988 +0000 UTC m=+21.823317748" Jun 02 19:04:11.705720 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.705647 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" podStartSLOduration=20.705640309 podStartE2EDuration="20.705640309s" podCreationTimestamp="2026-06-02 19:03:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:54.670341394 +0000 UTC m=+4.788145130" watchObservedRunningTime="2026-06-02 19:04:11.705640309 +0000 UTC m=+21.823444040" Jun 02 19:04:11.726355 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.726305 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s9rb9" podStartSLOduration=11.85047323 podStartE2EDuration="21.726291349s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.994589205 +0000 UTC m=+3.112392932" lastFinishedPulling="2026-06-02 19:04:02.870407336 +0000 UTC m=+12.988211051" observedRunningTime="2026-06-02 19:04:11.725831985 +0000 UTC m=+21.843635718" watchObservedRunningTime="2026-06-02 19:04:11.726291349 +0000 UTC m=+21.844095081" Jun 02 19:04:11.775596 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.775545 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xd4qd" podStartSLOduration=3.931431376 podStartE2EDuration="21.775531226s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.990321927 +0000 UTC m=+3.108125644" lastFinishedPulling="2026-06-02 19:04:10.83442177 +0000 UTC m=+20.952225494" observedRunningTime="2026-06-02 19:04:11.775016854 +0000 UTC m=+21.892820590" watchObservedRunningTime="2026-06-02 19:04:11.775531226 +0000 UTC m=+21.893334961" Jun 02 19:04:11.796022 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.795965 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-sx9b5" podStartSLOduration=3.975515079 podStartE2EDuration="21.795947575s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.98797713 +0000 UTC m=+3.105780844" lastFinishedPulling="2026-06-02 19:04:10.808409621 +0000 UTC m=+20.926213340" observedRunningTime="2026-06-02 19:04:11.795594164 +0000 UTC m=+21.913397899" watchObservedRunningTime="2026-06-02 19:04:11.795947575 +0000 UTC m=+21.913751309" Jun 02 19:04:11.815547 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:11.815500 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-drvmn" podStartSLOduration=3.973679939 podStartE2EDuration="21.815482978s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.993783554 +0000 UTC m=+3.111587270" lastFinishedPulling="2026-06-02 19:04:10.835586597 +0000 UTC m=+20.953390309" observedRunningTime="2026-06-02 19:04:11.815357646 +0000 UTC m=+21.933161380" watchObservedRunningTime="2026-06-02 19:04:11.815482978 +0000 UTC m=+21.933286713" Jun 02 19:04:12.101617 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.101578 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 19:04:12.460985 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.460828 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T19:04:12.101599648Z","UUID":"fd8c9b7f-4725-4530-8ef0-b492b2637271","Handler":null,"Name":"","Endpoint":""} Jun 02 19:04:12.463302 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.463281 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 19:04:12.463302 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.463307 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 19:04:12.482174 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.482144 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:12.482309 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.482157 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:12.482309 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:12.482276 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:12.482409 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:12.482380 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:12.706397 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.706365 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:04:12.706893 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.706837 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"12855e32e73cca87c431c6e56f933f4f97ee01415319da597c421bb7c3ec2bde"} Jun 02 19:04:12.708766 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.708724 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-998rf" event={"ID":"010d8cd5-c7d5-4c01-818f-32284bde3097","Type":"ContainerStarted","Data":"a7d938272c961c76c13d575b39460fcb2cadf0fd42567ef9f939e790263b95ff"} Jun 02 19:04:12.710651 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.710560 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" event={"ID":"22490daf-1c4b-4e9c-85da-2c0b44a24e42","Type":"ContainerStarted","Data":"274f5bef8c27b47c4d05c35491c5cb25b80895cb8f4fbfefbdfb24aa6e83acde"} Jun 02 19:04:12.726092 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:12.725987 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-998rf" podStartSLOduration=4.902503681 podStartE2EDuration="22.725969154s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.984920157 +0000 UTC m=+3.102723869" lastFinishedPulling="2026-06-02 19:04:10.808385611 +0000 UTC m=+20.926189342" observedRunningTime="2026-06-02 19:04:12.725600946 +0000 UTC m=+22.843404680" watchObservedRunningTime="2026-06-02 19:04:12.725969154 +0000 UTC m=+22.843772890" Jun 02 19:04:13.714951 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:13.714672 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" event={"ID":"22490daf-1c4b-4e9c-85da-2c0b44a24e42","Type":"ContainerStarted","Data":"f59dfa22261cf7fa9cee446ef1e0928fdde67b7d94d221beaa02a05ea0eebc83"} Jun 02 19:04:13.734046 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:13.733976 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-td7r2" podStartSLOduration=3.520503465 podStartE2EDuration="23.733960334s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.988891733 +0000 UTC m=+3.106695446" lastFinishedPulling="2026-06-02 19:04:13.202348601 +0000 UTC m=+23.320152315" observedRunningTime="2026-06-02 19:04:13.733676735 +0000 UTC m=+23.851480472" watchObservedRunningTime="2026-06-02 19:04:13.733960334 +0000 UTC m=+23.851764069" Jun 02 19:04:14.481603 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:14.481579 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:14.481762 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:14.481675 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:14.481807 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:14.481762 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:14.481864 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:14.481847 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:14.719152 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:14.719123 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:04:14.719804 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:14.719466 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"bd69c883cf48a97eb9a5151bc5e16e5ce40d1f3580e6ac5fab2c5befc96f50b5"} Jun 02 19:04:15.692189 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:15.692153 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:04:15.692941 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:15.692917 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:04:15.721105 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:15.721077 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:04:15.721595 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:15.721581 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s9rb9" Jun 02 19:04:16.484563 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:16.484499 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:16.484730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:16.484500 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:16.484730 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:16.484606 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:16.484730 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:16.484678 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:17.727112 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.726928 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:04:17.727667 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.727468 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"6a26bb7c59d68e8e9cff583b1351b8904f9f6f021b7a82f9e52a42d0e4dbf711"} Jun 02 19:04:17.727893 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.727870 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:04:17.728076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.728056 2582 scope.go:117] "RemoveContainer" containerID="c7cf19a4ff9abc6f46115d0b786f47d9812c8db842dacc0645501360d16f1861" Jun 02 19:04:17.729172 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.729146 2582 generic.go:358] "Generic (PLEG): container finished" podID="5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c" containerID="d290e468b6309ad3bf9b622460931f90bec3ebc22439f2d64515a0a04b8c1b0e" exitCode=0 Jun 02 19:04:17.729274 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.729231 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerDied","Data":"d290e468b6309ad3bf9b622460931f90bec3ebc22439f2d64515a0a04b8c1b0e"} Jun 02 19:04:17.744604 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:17.744577 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:04:18.482190 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.482156 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:18.482369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.482194 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:18.482369 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:18.482277 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:18.482487 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:18.482406 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:18.733546 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.733515 2582 generic.go:358] "Generic (PLEG): container finished" podID="5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c" containerID="e088718035a6aa84490abfc442879d8b5922ee0c7025a020665b09f633024a7d" exitCode=0 Jun 02 19:04:18.733975 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.733601 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerDied","Data":"e088718035a6aa84490abfc442879d8b5922ee0c7025a020665b09f633024a7d"} Jun 02 19:04:18.737715 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.737679 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:04:18.738186 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.738156 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" event={"ID":"1a21450a-8569-4423-828d-c6d81dfefeef","Type":"ContainerStarted","Data":"a53e8814289a33464b418a0b514ca5f66e37a25c0c2f35f639880dc182d0505f"} Jun 02 19:04:18.738631 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.738583 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:04:18.738631 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.738613 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:04:18.756414 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.756388 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:04:18.790583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.790321 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" podStartSLOduration=10.876286807 podStartE2EDuration="28.79030009s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.984956391 +0000 UTC m=+3.102760104" lastFinishedPulling="2026-06-02 19:04:10.898969668 +0000 UTC m=+21.016773387" observedRunningTime="2026-06-02 19:04:18.789345318 +0000 UTC m=+28.907149057" watchObservedRunningTime="2026-06-02 19:04:18.79030009 +0000 UTC m=+28.908103825" Jun 02 19:04:18.989998 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.989906 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kp8b"] Jun 02 19:04:18.990158 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.990052 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:18.990222 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:18.990162 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:18.990664 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.990640 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9h44x"] Jun 02 19:04:18.990794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:18.990776 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:18.990929 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:18.990904 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:19.742021 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:19.741937 2582 generic.go:358] "Generic (PLEG): container finished" podID="5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c" containerID="75e8fe1add803bf5b39d35cbb40168b53ab6199571a15c68e624d9399054e7ed" exitCode=0 Jun 02 19:04:19.742021 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:19.741981 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerDied","Data":"75e8fe1add803bf5b39d35cbb40168b53ab6199571a15c68e624d9399054e7ed"} Jun 02 19:04:20.481381 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:20.481271 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:20.481542 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:20.481405 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:20.481936 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:20.481272 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:20.481936 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:20.481883 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:22.484533 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:22.484457 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:22.485271 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:22.484457 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:22.485271 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:22.484560 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kp8b" podUID="223de34b-5150-4f97-8a71-a05ee3d62656" Jun 02 19:04:22.485271 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:22.484635 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:04:24.144712 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.144656 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:24.145162 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.144818 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:24.145162 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.144886 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:56.144869737 +0000 UTC m=+66.262673452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:24.208988 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.208954 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeReady" Jun 02 19:04:24.209142 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.209108 2582 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 19:04:24.253501 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.253467 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t4bcr"] Jun 02 19:04:24.256088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.256063 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.260307 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.260277 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdn92\"" Jun 02 19:04:24.260554 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.260531 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 19:04:24.260876 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.260854 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 19:04:24.261814 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.261793 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xqs4x"] Jun 02 19:04:24.264124 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.263789 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.267303 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.267221 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 19:04:24.267303 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.267290 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 19:04:24.270559 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.267322 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 19:04:24.270559 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.267441 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljpzl\"" Jun 02 19:04:24.270559 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.269899 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t4bcr"] Jun 02 19:04:24.274145 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.274117 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xqs4x"] Jun 02 19:04:24.346917 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.346881 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg76t\" (UniqueName: \"kubernetes.io/projected/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-kube-api-access-vg76t\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.347081 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.346938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.347081 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.346977 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:24.347081 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.347044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-tmp-dir\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.347083 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.347090 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.347107 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.347112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8h6p\" (UniqueName: \"kubernetes.io/projected/ac01c952-5f11-433e-91c4-2f49af4b1b99-kube-api-access-d8h6p\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.347120 2582 projected.go:194] Error preparing data for projected volume kube-api-access-z25wd for pod openshift-network-diagnostics/network-check-target-9kp8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.347186 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd podName:223de34b-5150-4f97-8a71-a05ee3d62656 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:56.347167953 +0000 UTC m=+66.464971667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z25wd" (UniqueName: "kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd") pod "network-check-target-9kp8b" (UID: "223de34b-5150-4f97-8a71-a05ee3d62656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:24.347223 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.347217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-config-volume\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.448482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448395 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-tmp-dir\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.448482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448440 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.448482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448469 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8h6p\" (UniqueName: \"kubernetes.io/projected/ac01c952-5f11-433e-91c4-2f49af4b1b99-kube-api-access-d8h6p\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.448794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448498 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-config-volume\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.448794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448534 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg76t\" (UniqueName: \"kubernetes.io/projected/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-kube-api-access-vg76t\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.448794 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.448595 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:24.448794 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.448670 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:24.948649586 +0000 UTC m=+35.066453315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:24.448999 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448844 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.448999 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.448885 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-tmp-dir\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.448999 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.448971 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:24.449177 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.449027 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:24.949012074 +0000 UTC m=+35.066815804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:24.449240 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.449222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-config-volume\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.462606 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.462446 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg76t\" (UniqueName: \"kubernetes.io/projected/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-kube-api-access-vg76t\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.462776 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.462549 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8h6p\" (UniqueName: \"kubernetes.io/projected/ac01c952-5f11-433e-91c4-2f49af4b1b99-kube-api-access-d8h6p\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.482177 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.482149 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:24.482177 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.482172 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:24.485970 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.485717 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:04:24.485970 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.485765 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:04:24.485970 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.485776 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:24.485970 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.485776 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kj59\"" Jun 02 19:04:24.485970 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.485866 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djr2n\"" Jun 02 19:04:24.952636 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.952598 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:24.952839 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:24.952675 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:24.952839 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.952769 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:24.952839 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.952828 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.952813531 +0000 UTC m=+36.070617248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:24.953371 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.953347 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:24.953445 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:24.953423 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.953402711 +0000 UTC m=+36.071206427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:25.960291 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:25.960263 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:25.960609 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:25.960331 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:25.960609 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:25.960403 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:25.960609 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:25.960446 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:25.960609 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:25.960466 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:27.960450185 +0000 UTC m=+38.078253897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:25.960609 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:25.960491 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:27.960475401 +0000 UTC m=+38.078279128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:26.758616 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:26.758574 2582 generic.go:358] "Generic (PLEG): container finished" podID="5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c" containerID="24fd9fb881d0c8e91a2231eca670e34c07d7b4d7e5de1001adee37c3d64ff9bd" exitCode=0 Jun 02 19:04:26.758791 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:26.758629 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerDied","Data":"24fd9fb881d0c8e91a2231eca670e34c07d7b4d7e5de1001adee37c3d64ff9bd"} Jun 02 19:04:27.763854 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:27.763814 2582 generic.go:358] "Generic (PLEG): container finished" podID="5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c" containerID="83d357dc28428feb8db7f953c818eb3b4c4ccca4f9c36ab15c92fca80146ad66" exitCode=0 Jun 02 19:04:27.764376 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:27.763891 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerDied","Data":"83d357dc28428feb8db7f953c818eb3b4c4ccca4f9c36ab15c92fca80146ad66"} Jun 02 19:04:27.973264 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:27.973224 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:27.973415 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:27.973286 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:27.973415 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:27.973374 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:27.973415 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:27.973385 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:27.973552 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:27.973433 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:31.973420181 +0000 UTC m=+42.091223892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:27.973552 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:27.973446 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:31.973440728 +0000 UTC m=+42.091244439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:28.767679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:28.767643 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2skj9" event={"ID":"5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c","Type":"ContainerStarted","Data":"63b90fdfe17097f1264af8174fb9fa666445e23c0b0c8928c96356b081df8da2"} Jun 02 19:04:28.800741 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:28.800646 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2skj9" podStartSLOduration=5.861514906 podStartE2EDuration="38.800632664s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.993354557 +0000 UTC m=+3.111158282" lastFinishedPulling="2026-06-02 19:04:25.932472328 +0000 UTC m=+36.050276040" observedRunningTime="2026-06-02 19:04:28.800284165 +0000 UTC m=+38.918087898" watchObservedRunningTime="2026-06-02 19:04:28.800632664 +0000 UTC m=+38.918436395" Jun 02 19:04:32.000920 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:32.000878 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:32.001289 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:32.000942 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:32.001289 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:32.001036 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:32.001289 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:32.001039 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:32.001289 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:32.001088 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:40.001074415 +0000 UTC m=+50.118878128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:32.001289 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:32.001100 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:40.001094413 +0000 UTC m=+50.118898124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:40.057305 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:40.057256 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:40.057840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:40.057320 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:40.057840 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:40.057420 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:40.057840 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:40.057422 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:40.057840 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:40.057481 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:56.057467007 +0000 UTC m=+66.175270718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:40.057840 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:40.057493 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:56.057487987 +0000 UTC m=+66.175291698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:41.632460 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.632429 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz"] Jun 02 19:04:41.658524 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.658490 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz"] Jun 02 19:04:41.658678 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.658603 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.661471 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.661436 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 19:04:41.661471 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.661465 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 19:04:41.662720 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.662703 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-57r89\"" Jun 02 19:04:41.662985 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.662969 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 19:04:41.663063 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.663024 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 19:04:41.669222 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.669199 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl"] Jun 02 19:04:41.676147 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.676130 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.679243 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.679224 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 19:04:41.679358 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.679270 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 19:04:41.679412 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.679373 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 19:04:41.679453 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.679420 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 19:04:41.683212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.683192 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl"] Jun 02 19:04:41.770044 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.770044 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17816a69-c8ea-4083-b037-8f83408cdc2e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5746866b9d-v6snz\" (UID: \"17816a69-c8ea-4083-b037-8f83408cdc2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.770247 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770071 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-ca\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.770247 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphpt\" (UniqueName: \"kubernetes.io/projected/fd99803b-989b-483b-a204-3e80220aba6a-kube-api-access-tphpt\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.770247 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770165 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-hub\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.770247 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.770247 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770234 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55t4h\" (UniqueName: \"kubernetes.io/projected/17816a69-c8ea-4083-b037-8f83408cdc2e-kube-api-access-55t4h\") pod \"managed-serviceaccount-addon-agent-5746866b9d-v6snz\" (UID: \"17816a69-c8ea-4083-b037-8f83408cdc2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.770401 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.770258 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/fd99803b-989b-483b-a204-3e80220aba6a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.870932 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.870884 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-hub\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.870932 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.870928 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.871164 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.870974 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55t4h\" (UniqueName: \"kubernetes.io/projected/17816a69-c8ea-4083-b037-8f83408cdc2e-kube-api-access-55t4h\") pod \"managed-serviceaccount-addon-agent-5746866b9d-v6snz\" (UID: \"17816a69-c8ea-4083-b037-8f83408cdc2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.871164 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.871000 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/fd99803b-989b-483b-a204-3e80220aba6a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.871164 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.871050 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.871164 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.871078 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17816a69-c8ea-4083-b037-8f83408cdc2e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5746866b9d-v6snz\" (UID: \"17816a69-c8ea-4083-b037-8f83408cdc2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.871164 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.871114 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-ca\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.871164 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.871143 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tphpt\" (UniqueName: \"kubernetes.io/projected/fd99803b-989b-483b-a204-3e80220aba6a-kube-api-access-tphpt\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.871889 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.871863 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/fd99803b-989b-483b-a204-3e80220aba6a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.874603 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.874574 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17816a69-c8ea-4083-b037-8f83408cdc2e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5746866b9d-v6snz\" (UID: \"17816a69-c8ea-4083-b037-8f83408cdc2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.874763 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.874743 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-ca\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.874837 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.874788 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.874892 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.874845 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.874892 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.874850 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd99803b-989b-483b-a204-3e80220aba6a-hub\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.880064 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.880041 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphpt\" (UniqueName: \"kubernetes.io/projected/fd99803b-989b-483b-a204-3e80220aba6a-kube-api-access-tphpt\") pod \"cluster-proxy-proxy-agent-585dc786cd-x9nvl\" (UID: \"fd99803b-989b-483b-a204-3e80220aba6a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:41.880172 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.880043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55t4h\" (UniqueName: \"kubernetes.io/projected/17816a69-c8ea-4083-b037-8f83408cdc2e-kube-api-access-55t4h\") pod \"managed-serviceaccount-addon-agent-5746866b9d-v6snz\" (UID: \"17816a69-c8ea-4083-b037-8f83408cdc2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.976338 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.976235 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" Jun 02 19:04:41.985292 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:41.985262 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:04:42.148514 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:42.148481 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz"] Jun 02 19:04:42.151472 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:04:42.151444 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17816a69_c8ea_4083_b037_8f83408cdc2e.slice/crio-b35990b29336ff1bf8d78493ccca7d3df449f456b60b236941e2f2005736f975 WatchSource:0}: Error finding container b35990b29336ff1bf8d78493ccca7d3df449f456b60b236941e2f2005736f975: Status 404 returned error can't find the container with id b35990b29336ff1bf8d78493ccca7d3df449f456b60b236941e2f2005736f975 Jun 02 19:04:42.157933 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:42.157898 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl"] Jun 02 19:04:42.161347 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:04:42.161324 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd99803b_989b_483b_a204_3e80220aba6a.slice/crio-1cfb041156c475d4df3a686386ea479ff611ae9ed88e293f4cf346748cb95683 WatchSource:0}: Error finding container 1cfb041156c475d4df3a686386ea479ff611ae9ed88e293f4cf346748cb95683: Status 404 returned error can't find the container with id 1cfb041156c475d4df3a686386ea479ff611ae9ed88e293f4cf346748cb95683 Jun 02 19:04:42.793433 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:42.793392 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" event={"ID":"fd99803b-989b-483b-a204-3e80220aba6a","Type":"ContainerStarted","Data":"1cfb041156c475d4df3a686386ea479ff611ae9ed88e293f4cf346748cb95683"} Jun 02 19:04:42.794718 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:42.794670 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" event={"ID":"17816a69-c8ea-4083-b037-8f83408cdc2e","Type":"ContainerStarted","Data":"b35990b29336ff1bf8d78493ccca7d3df449f456b60b236941e2f2005736f975"} Jun 02 19:04:45.803205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:45.803117 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" event={"ID":"fd99803b-989b-483b-a204-3e80220aba6a","Type":"ContainerStarted","Data":"76a8f542ff0a3c6dbed4eea7cb5d91841bca33369f156639b3a5f86c84112cd4"} Jun 02 19:04:49.813072 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:49.813029 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" event={"ID":"fd99803b-989b-483b-a204-3e80220aba6a","Type":"ContainerStarted","Data":"237ada36043bba761951c1881a1b8f86bac9dcc55ebf75f5bd99925d0348a563"} Jun 02 19:04:49.813072 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:49.813077 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" event={"ID":"fd99803b-989b-483b-a204-3e80220aba6a","Type":"ContainerStarted","Data":"a105d7da2684adfaa8af2df63eba05f629eb58fbc2f143ed208dd977829a24cb"} Jun 02 19:04:49.831777 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:49.831720 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" podStartSLOduration=1.742768128 podStartE2EDuration="8.831706919s" podCreationTimestamp="2026-06-02 19:04:41 +0000 UTC" firstStartedPulling="2026-06-02 19:04:42.162973329 +0000 UTC m=+52.280777041" lastFinishedPulling="2026-06-02 19:04:49.251912107 +0000 UTC m=+59.369715832" observedRunningTime="2026-06-02 19:04:49.831126123 +0000 UTC m=+59.948929858" watchObservedRunningTime="2026-06-02 19:04:49.831706919 +0000 UTC m=+59.949510654" Jun 02 19:04:50.756479 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:50.756446 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lfttw" Jun 02 19:04:51.818232 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:51.818197 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" event={"ID":"17816a69-c8ea-4083-b037-8f83408cdc2e","Type":"ContainerStarted","Data":"3a113458f09501084e45f20e39d6251919256ce3ecd31bef6c72fd5fdde49cc0"} Jun 02 19:04:51.835100 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:51.835050 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5746866b9d-v6snz" podStartSLOduration=1.3922643479999999 podStartE2EDuration="10.835027432s" podCreationTimestamp="2026-06-02 19:04:41 +0000 UTC" firstStartedPulling="2026-06-02 19:04:42.153470445 +0000 UTC m=+52.271274162" lastFinishedPulling="2026-06-02 19:04:51.59623353 +0000 UTC m=+61.714037246" observedRunningTime="2026-06-02 19:04:51.834566463 +0000 UTC m=+61.952370197" watchObservedRunningTime="2026-06-02 19:04:51.835027432 +0000 UTC m=+61.952831159" Jun 02 19:04:56.078119 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.078080 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:04:56.078516 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.078143 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:04:56.078516 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:56.078237 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:56.078516 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:56.078305 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:28.078287492 +0000 UTC m=+98.196091204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:04:56.078516 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:56.078247 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:56.078516 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:56.078380 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:28.078368646 +0000 UTC m=+98.196172357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:04:56.178654 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.178619 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:04:56.181557 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.181539 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:56.188976 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:56.188956 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:04:56.189041 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:04:56.189031 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:00.189012051 +0000 UTC m=+130.306815770 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : secret "metrics-daemon-secret" not found Jun 02 19:04:56.379960 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.379840 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:56.383131 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.383112 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:04:56.393018 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.392997 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:04:56.403781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.403751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z25wd\" (UniqueName: \"kubernetes.io/projected/223de34b-5150-4f97-8a71-a05ee3d62656-kube-api-access-z25wd\") pod \"network-check-target-9kp8b\" (UID: \"223de34b-5150-4f97-8a71-a05ee3d62656\") " pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:56.596112 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.596079 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djr2n\"" Jun 02 19:04:56.604114 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.604087 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:04:56.725059 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.725029 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kp8b"] Jun 02 19:04:56.728382 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:04:56.728356 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223de34b_5150_4f97_8a71_a05ee3d62656.slice/crio-b9be579d62dde9cf287591681a7d3c82940596f0ddad614e438cb2ca3bc4bb9f WatchSource:0}: Error finding container b9be579d62dde9cf287591681a7d3c82940596f0ddad614e438cb2ca3bc4bb9f: Status 404 returned error can't find the container with id b9be579d62dde9cf287591681a7d3c82940596f0ddad614e438cb2ca3bc4bb9f Jun 02 19:04:56.829624 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:04:56.829592 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kp8b" event={"ID":"223de34b-5150-4f97-8a71-a05ee3d62656","Type":"ContainerStarted","Data":"b9be579d62dde9cf287591681a7d3c82940596f0ddad614e438cb2ca3bc4bb9f"} Jun 02 19:05:00.839052 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:00.839015 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kp8b" event={"ID":"223de34b-5150-4f97-8a71-a05ee3d62656","Type":"ContainerStarted","Data":"f5686659ef6c54453143b49528cc06157561834199b6e5fe295555e52a818941"} Jun 02 19:05:00.839417 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:00.839245 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:05:00.856267 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:00.856222 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9kp8b" podStartSLOduration=67.554794125 podStartE2EDuration="1m10.85620815s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:04:56.730160966 +0000 UTC m=+66.847964677" lastFinishedPulling="2026-06-02 19:05:00.031574981 +0000 UTC m=+70.149378702" observedRunningTime="2026-06-02 19:05:00.855411274 +0000 UTC m=+70.973214998" watchObservedRunningTime="2026-06-02 19:05:00.85620815 +0000 UTC m=+70.974011901" Jun 02 19:05:28.108369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:28.108313 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:05:28.108893 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:28.108410 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:05:28.108893 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:05:28.108480 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:05:28.108893 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:05:28.108500 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:05:28.108893 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:05:28.108552 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert podName:ac01c952-5f11-433e-91c4-2f49af4b1b99 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:32.108533464 +0000 UTC m=+162.226337185 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert") pod "ingress-canary-xqs4x" (UID: "ac01c952-5f11-433e-91c4-2f49af4b1b99") : secret "canary-serving-cert" not found Jun 02 19:05:28.108893 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:05:28.108565 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls podName:12c0da33-5749-4e0c-ad2b-4e59c7f92ef7 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:32.108559903 +0000 UTC m=+162.226363618 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls") pod "dns-default-t4bcr" (UID: "12c0da33-5749-4e0c-ad2b-4e59c7f92ef7") : secret "dns-default-metrics-tls" not found Jun 02 19:05:31.845018 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:31.844984 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9kp8b" Jun 02 19:05:57.773395 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:57.773369 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sx9b5_38748609-4237-4055-92e5-748cfde31ac3/dns-node-resolver/0.log" Jun 02 19:05:58.372456 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:05:58.372425 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjv7r_3a839b66-3621-4f01-8a52-ce1a23d49318/node-ca/0.log" Jun 02 19:06:00.237884 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:00.237812 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:06:00.238260 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:00.237967 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:06:00.238260 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:00.238034 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs podName:f60ab9c9-dd63-42f3-927d-c54786d84726 nodeName:}" failed. No retries permitted until 2026-06-02 19:08:02.23801813 +0000 UTC m=+252.355821845 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs") pod "network-metrics-daemon-9h44x" (UID: "f60ab9c9-dd63-42f3-927d-c54786d84726") : secret "metrics-daemon-secret" not found Jun 02 19:06:11.986675 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:11.986622 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" podUID="fd99803b-989b-483b-a204-3e80220aba6a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 19:06:16.674509 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.674477 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4lj2x"] Jun 02 19:06:16.676667 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.676652 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.680418 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.680398 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 19:06:16.680839 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.680823 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 19:06:16.682545 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.682229 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 19:06:16.682545 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.682236 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 19:06:16.682700 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.682671 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsdwt\"" Jun 02 19:06:16.694103 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.694080 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4lj2x"] Jun 02 19:06:16.756083 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.756044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f087363e-5a5b-4342-b97d-56ecd47ca28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.756249 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.756103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72b8k\" (UniqueName: \"kubernetes.io/projected/f087363e-5a5b-4342-b97d-56ecd47ca28e-kube-api-access-72b8k\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.756249 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.756125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f087363e-5a5b-4342-b97d-56ecd47ca28e-crio-socket\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.756249 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.756186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f087363e-5a5b-4342-b97d-56ecd47ca28e-data-volume\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.756249 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.756203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f087363e-5a5b-4342-b97d-56ecd47ca28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857080 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857039 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f087363e-5a5b-4342-b97d-56ecd47ca28e-data-volume\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857080 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857082 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f087363e-5a5b-4342-b97d-56ecd47ca28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857308 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857129 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f087363e-5a5b-4342-b97d-56ecd47ca28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857308 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857174 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72b8k\" (UniqueName: \"kubernetes.io/projected/f087363e-5a5b-4342-b97d-56ecd47ca28e-kube-api-access-72b8k\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857308 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857203 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f087363e-5a5b-4342-b97d-56ecd47ca28e-crio-socket\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857308 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857280 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f087363e-5a5b-4342-b97d-56ecd47ca28e-crio-socket\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857465 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857440 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f087363e-5a5b-4342-b97d-56ecd47ca28e-data-volume\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.857638 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.857620 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f087363e-5a5b-4342-b97d-56ecd47ca28e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.859478 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.859457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f087363e-5a5b-4342-b97d-56ecd47ca28e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.866911 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.866887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72b8k\" (UniqueName: \"kubernetes.io/projected/f087363e-5a5b-4342-b97d-56ecd47ca28e-kube-api-access-72b8k\") pod \"insights-runtime-extractor-4lj2x\" (UID: \"f087363e-5a5b-4342-b97d-56ecd47ca28e\") " pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:16.985266 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:16.985184 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4lj2x" Jun 02 19:06:17.115060 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:17.115025 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4lj2x"] Jun 02 19:06:17.118979 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:17.118948 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf087363e_5a5b_4342_b97d_56ecd47ca28e.slice/crio-217ab1b06536fe97060104c5e4f2ce6ecb1e089275bfefcb0202c69b88dcdc13 WatchSource:0}: Error finding container 217ab1b06536fe97060104c5e4f2ce6ecb1e089275bfefcb0202c69b88dcdc13: Status 404 returned error can't find the container with id 217ab1b06536fe97060104c5e4f2ce6ecb1e089275bfefcb0202c69b88dcdc13 Jun 02 19:06:18.013983 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:18.013950 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lj2x" event={"ID":"f087363e-5a5b-4342-b97d-56ecd47ca28e","Type":"ContainerStarted","Data":"4de3f3b99cd6e2bb7ca45bcac2e607bdf13915e3483b1ac3e0b2a8d8654b07d8"} Jun 02 19:06:18.013983 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:18.013987 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lj2x" event={"ID":"f087363e-5a5b-4342-b97d-56ecd47ca28e","Type":"ContainerStarted","Data":"9ceb660fff0ca88bafae29221ed489c05836e38b2b42b2016ff207413e62f3f6"} Jun 02 19:06:18.014382 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:18.013998 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lj2x" event={"ID":"f087363e-5a5b-4342-b97d-56ecd47ca28e","Type":"ContainerStarted","Data":"217ab1b06536fe97060104c5e4f2ce6ecb1e089275bfefcb0202c69b88dcdc13"} Jun 02 19:06:20.021168 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:20.021127 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lj2x" event={"ID":"f087363e-5a5b-4342-b97d-56ecd47ca28e","Type":"ContainerStarted","Data":"f632a2ab277c062be7c1b6a5aabe50577b92eb34dbe7796c062bc6cd373c19ab"} Jun 02 19:06:20.039482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:20.039430 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4lj2x" podStartSLOduration=1.69064739 podStartE2EDuration="4.039415268s" podCreationTimestamp="2026-06-02 19:06:16 +0000 UTC" firstStartedPulling="2026-06-02 19:06:17.17444194 +0000 UTC m=+147.292245652" lastFinishedPulling="2026-06-02 19:06:19.523209815 +0000 UTC m=+149.641013530" observedRunningTime="2026-06-02 19:06:20.039250283 +0000 UTC m=+150.157054017" watchObservedRunningTime="2026-06-02 19:06:20.039415268 +0000 UTC m=+150.157219005" Jun 02 19:06:21.986891 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:21.986850 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" podUID="fd99803b-989b-483b-a204-3e80220aba6a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 19:06:27.267871 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:27.267814 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t4bcr" podUID="12c0da33-5749-4e0c-ad2b-4e59c7f92ef7" Jun 02 19:06:27.278951 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:27.278919 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-xqs4x" podUID="ac01c952-5f11-433e-91c4-2f49af4b1b99" Jun 02 19:06:27.498528 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:27.498450 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9h44x" podUID="f60ab9c9-dd63-42f3-927d-c54786d84726" Jun 02 19:06:28.020591 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.020558 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl"] Jun 02 19:06:28.022761 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.022746 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.025474 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.025453 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 19:06:28.025577 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.025453 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gk6n9\"" Jun 02 19:06:28.026648 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.026627 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 19:06:28.026775 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.026671 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 19:06:28.026775 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.026762 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 19:06:28.026876 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.026777 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 19:06:28.036577 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.036543 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl"] Jun 02 19:06:28.039672 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.039651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.039775 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.039717 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2b4b\" (UniqueName: \"kubernetes.io/projected/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-kube-api-access-q2b4b\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.039775 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.039742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.039861 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.039842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.040566 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.040545 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:06:28.040644 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.040545 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4bcr" Jun 02 19:06:28.140456 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.140417 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.140644 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.140577 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.140735 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.140685 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2b4b\" (UniqueName: \"kubernetes.io/projected/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-kube-api-access-q2b4b\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.140807 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.140743 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.141287 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.141264 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.142865 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.142845 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.143102 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.143081 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.148930 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.148906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2b4b\" (UniqueName: \"kubernetes.io/projected/46ba56a2-6475-42ad-ab7b-2b48b1ed9747-kube-api-access-q2b4b\") pod \"prometheus-operator-658bcd8bdf-sgfhl\" (UID: \"46ba56a2-6475-42ad-ab7b-2b48b1ed9747\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.331566 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.331536 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" Jun 02 19:06:28.453757 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:28.453727 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl"] Jun 02 19:06:28.456978 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:28.456949 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ba56a2_6475_42ad_ab7b_2b48b1ed9747.slice/crio-7f457b185d47065a30e988bbd5fde9bd6443701009b0adcc3894c40d4f7fcbcc WatchSource:0}: Error finding container 7f457b185d47065a30e988bbd5fde9bd6443701009b0adcc3894c40d4f7fcbcc: Status 404 returned error can't find the container with id 7f457b185d47065a30e988bbd5fde9bd6443701009b0adcc3894c40d4f7fcbcc Jun 02 19:06:29.044352 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:29.044319 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" event={"ID":"46ba56a2-6475-42ad-ab7b-2b48b1ed9747","Type":"ContainerStarted","Data":"7f457b185d47065a30e988bbd5fde9bd6443701009b0adcc3894c40d4f7fcbcc"} Jun 02 19:06:31.050414 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.050377 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" event={"ID":"46ba56a2-6475-42ad-ab7b-2b48b1ed9747","Type":"ContainerStarted","Data":"25ea9391efbb4161221ff9d8199dc580d147320c41b0c47f64653f4c4124f436"} Jun 02 19:06:31.050414 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.050416 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" event={"ID":"46ba56a2-6475-42ad-ab7b-2b48b1ed9747","Type":"ContainerStarted","Data":"b5b7e10c62852ccabfd949daa72ea3dda598fcc5382852ad806bb9ea2b04f1dc"} Jun 02 19:06:31.078762 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.078721 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgfhl" podStartSLOduration=1.5332403289999998 podStartE2EDuration="3.078705144s" podCreationTimestamp="2026-06-02 19:06:28 +0000 UTC" firstStartedPulling="2026-06-02 19:06:28.458892744 +0000 UTC m=+158.576696455" lastFinishedPulling="2026-06-02 19:06:30.004357558 +0000 UTC m=+160.122161270" observedRunningTime="2026-06-02 19:06:31.078115497 +0000 UTC m=+161.195919232" watchObservedRunningTime="2026-06-02 19:06:31.078705144 +0000 UTC m=+161.196508868" Jun 02 19:06:31.986413 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.986374 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" podUID="fd99803b-989b-483b-a204-3e80220aba6a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 19:06:31.986574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.986453 2582 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" Jun 02 19:06:31.986962 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.986931 2582 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"237ada36043bba761951c1881a1b8f86bac9dcc55ebf75f5bd99925d0348a563"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 19:06:31.987004 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:31.986983 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" podUID="fd99803b-989b-483b-a204-3e80220aba6a" containerName="service-proxy" containerID="cri-o://237ada36043bba761951c1881a1b8f86bac9dcc55ebf75f5bd99925d0348a563" gracePeriod=30 Jun 02 19:06:32.169661 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.169617 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:06:32.170078 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.169779 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:06:32.172166 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.172141 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12c0da33-5749-4e0c-ad2b-4e59c7f92ef7-metrics-tls\") pod \"dns-default-t4bcr\" (UID: \"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7\") " pod="openshift-dns/dns-default-t4bcr" Jun 02 19:06:32.172272 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.172240 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01c952-5f11-433e-91c4-2f49af4b1b99-cert\") pod \"ingress-canary-xqs4x\" (UID: \"ac01c952-5f11-433e-91c4-2f49af4b1b99\") " pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:06:32.244050 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.243965 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdn92\"" Jun 02 19:06:32.245092 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.245074 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljpzl\"" Jun 02 19:06:32.251319 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.251299 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4bcr" Jun 02 19:06:32.251423 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.251397 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xqs4x" Jun 02 19:06:32.384170 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.384135 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xqs4x"] Jun 02 19:06:32.387277 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:32.387252 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac01c952_5f11_433e_91c4_2f49af4b1b99.slice/crio-3fe67b11269ac791fe1b7dda09cf7d9b1873421ccc02e27ee835cb312fcc54c8 WatchSource:0}: Error finding container 3fe67b11269ac791fe1b7dda09cf7d9b1873421ccc02e27ee835cb312fcc54c8: Status 404 returned error can't find the container with id 3fe67b11269ac791fe1b7dda09cf7d9b1873421ccc02e27ee835cb312fcc54c8 Jun 02 19:06:32.398190 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:32.398166 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t4bcr"] Jun 02 19:06:32.401132 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:32.401104 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c0da33_5749_4e0c_ad2b_4e59c7f92ef7.slice/crio-6b076f3adae433fab3664fde7bec36a6eb303436cea25fae64039e0d0d51fe01 WatchSource:0}: Error finding container 6b076f3adae433fab3664fde7bec36a6eb303436cea25fae64039e0d0d51fe01: Status 404 returned error can't find the container with id 6b076f3adae433fab3664fde7bec36a6eb303436cea25fae64039e0d0d51fe01 Jun 02 19:06:33.058436 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.058402 2582 generic.go:358] "Generic (PLEG): container finished" podID="fd99803b-989b-483b-a204-3e80220aba6a" containerID="237ada36043bba761951c1881a1b8f86bac9dcc55ebf75f5bd99925d0348a563" exitCode=2 Jun 02 19:06:33.058619 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.058487 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" event={"ID":"fd99803b-989b-483b-a204-3e80220aba6a","Type":"ContainerDied","Data":"237ada36043bba761951c1881a1b8f86bac9dcc55ebf75f5bd99925d0348a563"} Jun 02 19:06:33.058619 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.058529 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-585dc786cd-x9nvl" event={"ID":"fd99803b-989b-483b-a204-3e80220aba6a","Type":"ContainerStarted","Data":"c585617b3e186f82b71735e95f6b65acffc8d704002f937e8d6585dab45a1c74"} Jun 02 19:06:33.059806 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.059780 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xqs4x" event={"ID":"ac01c952-5f11-433e-91c4-2f49af4b1b99","Type":"ContainerStarted","Data":"3fe67b11269ac791fe1b7dda09cf7d9b1873421ccc02e27ee835cb312fcc54c8"} Jun 02 19:06:33.060900 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.060862 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4bcr" event={"ID":"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7","Type":"ContainerStarted","Data":"6b076f3adae433fab3664fde7bec36a6eb303436cea25fae64039e0d0d51fe01"} Jun 02 19:06:33.398640 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.398605 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v7n2c"] Jun 02 19:06:33.401193 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.401168 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.404261 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.403942 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 19:06:33.404261 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.404061 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 19:06:33.404261 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.404100 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 19:06:33.404581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.404559 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dnvg8\"" Jun 02 19:06:33.480709 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.480611 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-tls\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.480920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-wtmp\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.480991 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82b8q\" (UniqueName: \"kubernetes.io/projected/2c34b7ef-161b-4068-960b-288cdf8439d7-kube-api-access-82b8q\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.481028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-sys\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.481053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-textfile\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.481084 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481394 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.481151 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481394 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.481214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c34b7ef-161b-4068-960b-288cdf8439d7-metrics-client-ca\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.481394 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.481285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-root\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582645 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582612 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-tls\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582652 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-wtmp\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582681 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82b8q\" (UniqueName: \"kubernetes.io/projected/2c34b7ef-161b-4068-960b-288cdf8439d7-kube-api-access-82b8q\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582735 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-sys\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582768 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-textfile\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582798 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.582840 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582836 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-wtmp\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582896 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c34b7ef-161b-4068-960b-288cdf8439d7-metrics-client-ca\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582925 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-root\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:33.582969 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.582980 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-root\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.583018 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c34b7ef-161b-4068-960b-288cdf8439d7-sys\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583123 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:06:33.583028 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-tls podName:2c34b7ef-161b-4068-960b-288cdf8439d7 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:34.083008071 +0000 UTC m=+164.200811797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-tls") pod "node-exporter-v7n2c" (UID: "2c34b7ef-161b-4068-960b-288cdf8439d7") : secret "node-exporter-tls" not found Jun 02 19:06:33.583408 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.583341 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-textfile\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583702 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.583669 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.583832 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.583785 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c34b7ef-161b-4068-960b-288cdf8439d7-metrics-client-ca\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.585634 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.585597 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:33.593963 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:33.593912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82b8q\" (UniqueName: \"kubernetes.io/projected/2c34b7ef-161b-4068-960b-288cdf8439d7-kube-api-access-82b8q\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:34.066535 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:34.066482 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4bcr" event={"ID":"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7","Type":"ContainerStarted","Data":"6782ad47d1cc2e38bfa4b1edbcaa038f7f6b2df7d0900cefb66d0217b97ffc71"} Jun 02 19:06:34.085928 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:34.085884 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-tls\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:34.088458 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:34.088391 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c34b7ef-161b-4068-960b-288cdf8439d7-node-exporter-tls\") pod \"node-exporter-v7n2c\" (UID: \"2c34b7ef-161b-4068-960b-288cdf8439d7\") " pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:34.312299 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:34.312260 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v7n2c" Jun 02 19:06:34.421838 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:34.421796 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c34b7ef_161b_4068_960b_288cdf8439d7.slice/crio-59e80f24e330923afa92be3ce4710e455000050e7ce0a95c80315b94b99caa85 WatchSource:0}: Error finding container 59e80f24e330923afa92be3ce4710e455000050e7ce0a95c80315b94b99caa85: Status 404 returned error can't find the container with id 59e80f24e330923afa92be3ce4710e455000050e7ce0a95c80315b94b99caa85 Jun 02 19:06:35.070372 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:35.070335 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xqs4x" event={"ID":"ac01c952-5f11-433e-91c4-2f49af4b1b99","Type":"ContainerStarted","Data":"efe21fe23db5a6d8a1aea06ab260e34b935b89f9ad973d6c492a50f99ef531f0"} Jun 02 19:06:35.072116 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:35.072074 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4bcr" event={"ID":"12c0da33-5749-4e0c-ad2b-4e59c7f92ef7","Type":"ContainerStarted","Data":"6077d847f26808786a2ffb57b53aa371f5a867612b13944d501a11c34c477eab"} Jun 02 19:06:35.072252 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:35.072164 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t4bcr" Jun 02 19:06:35.073218 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:35.073199 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v7n2c" event={"ID":"2c34b7ef-161b-4068-960b-288cdf8439d7","Type":"ContainerStarted","Data":"59e80f24e330923afa92be3ce4710e455000050e7ce0a95c80315b94b99caa85"} Jun 02 19:06:35.097404 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:35.097357 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xqs4x" podStartSLOduration=129.030108115 podStartE2EDuration="2m11.097341254s" podCreationTimestamp="2026-06-02 19:04:24 +0000 UTC" firstStartedPulling="2026-06-02 19:06:32.389380357 +0000 UTC m=+162.507184069" lastFinishedPulling="2026-06-02 19:06:34.456613474 +0000 UTC m=+164.574417208" observedRunningTime="2026-06-02 19:06:35.096420237 +0000 UTC m=+165.214223995" watchObservedRunningTime="2026-06-02 19:06:35.097341254 +0000 UTC m=+165.215144989" Jun 02 19:06:35.117653 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:35.117589 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-t4bcr" podStartSLOduration=129.682073993 podStartE2EDuration="2m11.117568438s" podCreationTimestamp="2026-06-02 19:04:24 +0000 UTC" firstStartedPulling="2026-06-02 19:06:32.404787436 +0000 UTC m=+162.522591151" lastFinishedPulling="2026-06-02 19:06:33.840281871 +0000 UTC m=+163.958085596" observedRunningTime="2026-06-02 19:06:35.117430206 +0000 UTC m=+165.235233940" watchObservedRunningTime="2026-06-02 19:06:35.117568438 +0000 UTC m=+165.235372172" Jun 02 19:06:36.077173 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.077131 2582 generic.go:358] "Generic (PLEG): container finished" podID="2c34b7ef-161b-4068-960b-288cdf8439d7" containerID="7aa454f8d458a65c3ca8b9d4c7a9ffca160abd9f7d797b84159e5fc66ea94aed" exitCode=0 Jun 02 19:06:36.077540 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.077215 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v7n2c" event={"ID":"2c34b7ef-161b-4068-960b-288cdf8439d7","Type":"ContainerDied","Data":"7aa454f8d458a65c3ca8b9d4c7a9ffca160abd9f7d797b84159e5fc66ea94aed"} Jun 02 19:06:36.371667 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.371570 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74f5658fd8-5bfj5"] Jun 02 19:06:36.374191 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.374174 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.377171 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.377144 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 19:06:36.377264 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.377144 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 19:06:36.377585 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.377568 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 19:06:36.377639 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.377624 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gf6j8\"" Jun 02 19:06:36.377723 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.377701 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 19:06:36.377963 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.377942 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4so12h58sgmhi\"" Jun 02 19:06:36.378051 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.378014 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 19:06:36.393950 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.393902 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74f5658fd8-5bfj5"] Jun 02 19:06:36.406045 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406019 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebf633aa-b238-4ba8-9ed4-da43c0f14884-metrics-client-ca\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406161 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406051 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406161 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406161 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406147 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406173 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-grpc-tls\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-tls\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5d22\" (UniqueName: \"kubernetes.io/projected/ebf633aa-b238-4ba8-9ed4-da43c0f14884-kube-api-access-m5d22\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.406273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.406269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.506938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.506896 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.506938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.506938 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebf633aa-b238-4ba8-9ed4-da43c0f14884-metrics-client-ca\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507208 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.506960 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507208 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.506999 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507208 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.507021 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507208 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.507044 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-grpc-tls\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507208 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.507189 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-tls\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507436 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.507236 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5d22\" (UniqueName: \"kubernetes.io/projected/ebf633aa-b238-4ba8-9ed4-da43c0f14884-kube-api-access-m5d22\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.507828 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.507800 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebf633aa-b238-4ba8-9ed4-da43c0f14884-metrics-client-ca\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.509803 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.509678 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.509803 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.509757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-grpc-tls\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.509996 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.509821 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.510050 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.510008 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.510198 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.510176 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.510446 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.510428 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebf633aa-b238-4ba8-9ed4-da43c0f14884-secret-thanos-querier-tls\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.515252 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.515236 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5d22\" (UniqueName: \"kubernetes.io/projected/ebf633aa-b238-4ba8-9ed4-da43c0f14884-kube-api-access-m5d22\") pod \"thanos-querier-74f5658fd8-5bfj5\" (UID: \"ebf633aa-b238-4ba8-9ed4-da43c0f14884\") " pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.682917 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.682828 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:36.837940 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:36.837901 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74f5658fd8-5bfj5"] Jun 02 19:06:36.843230 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:36.843183 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf633aa_b238_4ba8_9ed4_da43c0f14884.slice/crio-a123a23674f1096753eb93b259c66f6d4f2f6facaf917e313736dcde6c87abe7 WatchSource:0}: Error finding container a123a23674f1096753eb93b259c66f6d4f2f6facaf917e313736dcde6c87abe7: Status 404 returned error can't find the container with id a123a23674f1096753eb93b259c66f6d4f2f6facaf917e313736dcde6c87abe7 Jun 02 19:06:37.082102 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:37.082067 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v7n2c" event={"ID":"2c34b7ef-161b-4068-960b-288cdf8439d7","Type":"ContainerStarted","Data":"ebb8f7641d34f8aab74aaf2522d1eea75bca15078fa4cf282ec2b2b44ab8d740"} Jun 02 19:06:37.082102 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:37.082105 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v7n2c" event={"ID":"2c34b7ef-161b-4068-960b-288cdf8439d7","Type":"ContainerStarted","Data":"208bc571df7673f44aea376b5cc2f05709e46fdd08e4e37c9d466e163b513016"} Jun 02 19:06:37.083122 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:37.083101 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"a123a23674f1096753eb93b259c66f6d4f2f6facaf917e313736dcde6c87abe7"} Jun 02 19:06:37.105844 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:37.105754 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v7n2c" podStartSLOduration=3.103982946 podStartE2EDuration="4.105735676s" podCreationTimestamp="2026-06-02 19:06:33 +0000 UTC" firstStartedPulling="2026-06-02 19:06:34.427574675 +0000 UTC m=+164.545378388" lastFinishedPulling="2026-06-02 19:06:35.429327397 +0000 UTC m=+165.547131118" observedRunningTime="2026-06-02 19:06:37.105274209 +0000 UTC m=+167.223077945" watchObservedRunningTime="2026-06-02 19:06:37.105735676 +0000 UTC m=+167.223539412" Jun 02 19:06:38.212081 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.212040 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2"] Jun 02 19:06:38.214674 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.214651 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:38.218025 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.217998 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-78fzh\"" Jun 02 19:06:38.218206 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.218185 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 19:06:38.256122 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.256092 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2"] Jun 02 19:06:38.323542 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.323507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e389a29-41e4-45f2-aa8d-a818d31852eb-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qfrz2\" (UID: \"4e389a29-41e4-45f2-aa8d-a818d31852eb\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:38.424894 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.424852 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e389a29-41e4-45f2-aa8d-a818d31852eb-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qfrz2\" (UID: \"4e389a29-41e4-45f2-aa8d-a818d31852eb\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:38.427264 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.427233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e389a29-41e4-45f2-aa8d-a818d31852eb-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qfrz2\" (UID: \"4e389a29-41e4-45f2-aa8d-a818d31852eb\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:38.525719 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:38.525621 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:39.155242 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:39.155217 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2"] Jun 02 19:06:39.158436 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:06:39.158408 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e389a29_41e4_45f2_aa8d_a818d31852eb.slice/crio-96b0b9dfcd9b8061b520289455ae0d994b6e92d023bff13cd21aab9177f0c18f WatchSource:0}: Error finding container 96b0b9dfcd9b8061b520289455ae0d994b6e92d023bff13cd21aab9177f0c18f: Status 404 returned error can't find the container with id 96b0b9dfcd9b8061b520289455ae0d994b6e92d023bff13cd21aab9177f0c18f Jun 02 19:06:40.095514 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:40.095485 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" event={"ID":"4e389a29-41e4-45f2-aa8d-a818d31852eb","Type":"ContainerStarted","Data":"96b0b9dfcd9b8061b520289455ae0d994b6e92d023bff13cd21aab9177f0c18f"} Jun 02 19:06:40.098931 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:40.098849 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"e172bd73b6404578bbe3d1c2df0a77edd3bf785bac2f01862dbb15812efc36bd"} Jun 02 19:06:40.098931 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:40.098886 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"1a9228dc8b6e30827b217e84203a4fa3c28377543bc43205b609cff6a11b6c11"} Jun 02 19:06:40.098931 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:40.098895 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"0b05b869507cf6db605136250caeb4ab90372fa4df0b76a157f8cdfa91774786"} Jun 02 19:06:40.098931 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:40.098904 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"9ba6c8fbe0bfcfae4b36bb7c2bc195db0a42fd93c936b2c1120723cd1a106cb7"} Jun 02 19:06:40.098931 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:40.098913 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"0a88a94146bc3f0dcd5a3f86a51175d7535a5bb96ead7aa4ce61374ecfd113e1"} Jun 02 19:06:41.102637 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.102585 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" event={"ID":"4e389a29-41e4-45f2-aa8d-a818d31852eb","Type":"ContainerStarted","Data":"b11a0cf3ab86f472230f3d6b78a69e65c1c29804e7ceda78b133dad76fb896c2"} Jun 02 19:06:41.103118 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.102807 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:41.105530 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.105505 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" event={"ID":"ebf633aa-b238-4ba8-9ed4-da43c0f14884","Type":"ContainerStarted","Data":"ca7f6b5f60a2bf722acb19cdfd1c9916973d28bf4de70f6c7bca30cfe88c8059"} Jun 02 19:06:41.105761 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.105749 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:06:41.108425 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.108406 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" Jun 02 19:06:41.117921 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.117884 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qfrz2" podStartSLOduration=1.423528014 podStartE2EDuration="3.117870695s" podCreationTimestamp="2026-06-02 19:06:38 +0000 UTC" firstStartedPulling="2026-06-02 19:06:39.160296225 +0000 UTC m=+169.278099940" lastFinishedPulling="2026-06-02 19:06:40.854638909 +0000 UTC m=+170.972442621" observedRunningTime="2026-06-02 19:06:41.117544621 +0000 UTC m=+171.235348354" watchObservedRunningTime="2026-06-02 19:06:41.117870695 +0000 UTC m=+171.235674408" Jun 02 19:06:41.140854 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.140805 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" podStartSLOduration=2.060316798 podStartE2EDuration="5.140792743s" podCreationTimestamp="2026-06-02 19:06:36 +0000 UTC" firstStartedPulling="2026-06-02 19:06:36.845367663 +0000 UTC m=+166.963171374" lastFinishedPulling="2026-06-02 19:06:39.925843603 +0000 UTC m=+170.043647319" observedRunningTime="2026-06-02 19:06:41.13892911 +0000 UTC m=+171.256732845" watchObservedRunningTime="2026-06-02 19:06:41.140792743 +0000 UTC m=+171.258596476" Jun 02 19:06:41.481986 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:41.481896 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:06:45.080254 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:45.080224 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t4bcr" Jun 02 19:06:47.114273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:06:47.114242 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74f5658fd8-5bfj5" Jun 02 19:08:02.268004 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:02.267961 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:08:02.270224 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:02.270204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ab9c9-dd63-42f3-927d-c54786d84726-metrics-certs\") pod \"network-metrics-daemon-9h44x\" (UID: \"f60ab9c9-dd63-42f3-927d-c54786d84726\") " pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:08:02.485808 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:02.485777 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kj59\"" Jun 02 19:08:02.493134 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:02.493114 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9h44x" Jun 02 19:08:02.613714 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:02.613662 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9h44x"] Jun 02 19:08:02.617789 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:08:02.617753 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ab9c9_dd63_42f3_927d_c54786d84726.slice/crio-8bae231c27214a10cc261a0c1d4d92ddd87cb0834060d7fe669a2d47fead7755 WatchSource:0}: Error finding container 8bae231c27214a10cc261a0c1d4d92ddd87cb0834060d7fe669a2d47fead7755: Status 404 returned error can't find the container with id 8bae231c27214a10cc261a0c1d4d92ddd87cb0834060d7fe669a2d47fead7755 Jun 02 19:08:03.327560 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:03.327525 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9h44x" event={"ID":"f60ab9c9-dd63-42f3-927d-c54786d84726","Type":"ContainerStarted","Data":"8bae231c27214a10cc261a0c1d4d92ddd87cb0834060d7fe669a2d47fead7755"} Jun 02 19:08:04.332468 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:04.332431 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9h44x" event={"ID":"f60ab9c9-dd63-42f3-927d-c54786d84726","Type":"ContainerStarted","Data":"877428acab0e6ab24c05a4d1e357e550a6c8dbb61527f4a818c3df22d115be10"} Jun 02 19:08:04.332468 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:04.332470 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9h44x" event={"ID":"f60ab9c9-dd63-42f3-927d-c54786d84726","Type":"ContainerStarted","Data":"9429fa2e9565e5d9af35b55f74f29493015d6dc05c429136b91e8b9bd8095715"} Jun 02 19:08:04.351611 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:04.350989 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9h44x" podStartSLOduration=253.264012551 podStartE2EDuration="4m14.350969238s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:08:02.619552174 +0000 UTC m=+252.737355899" lastFinishedPulling="2026-06-02 19:08:03.706508875 +0000 UTC m=+253.824312586" observedRunningTime="2026-06-02 19:08:04.350357246 +0000 UTC m=+254.468160979" watchObservedRunningTime="2026-06-02 19:08:04.350969238 +0000 UTC m=+254.468772973" Jun 02 19:08:24.071865 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.071829 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bp4vh"] Jun 02 19:08:24.074563 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.074546 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.077911 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.077888 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 19:08:24.083800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.083778 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp4vh"] Jun 02 19:08:24.224758 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.224724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/295b2bad-5e16-438c-a93c-651780b57362-kubelet-config\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.224758 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.224758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/295b2bad-5e16-438c-a93c-651780b57362-dbus\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.224982 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.224782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/295b2bad-5e16-438c-a93c-651780b57362-original-pull-secret\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.325696 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.325668 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/295b2bad-5e16-438c-a93c-651780b57362-kubelet-config\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.325862 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.325715 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/295b2bad-5e16-438c-a93c-651780b57362-dbus\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.325862 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.325741 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/295b2bad-5e16-438c-a93c-651780b57362-original-pull-secret\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.325862 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.325801 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/295b2bad-5e16-438c-a93c-651780b57362-kubelet-config\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.325969 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.325923 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/295b2bad-5e16-438c-a93c-651780b57362-dbus\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.327968 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.327940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/295b2bad-5e16-438c-a93c-651780b57362-original-pull-secret\") pod \"global-pull-secret-syncer-bp4vh\" (UID: \"295b2bad-5e16-438c-a93c-651780b57362\") " pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.383312 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.383262 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp4vh" Jun 02 19:08:24.522290 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:24.522254 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp4vh"] Jun 02 19:08:24.525615 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:08:24.525579 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295b2bad_5e16_438c_a93c_651780b57362.slice/crio-744c0263c8a44d6ee09ef7e96d60d1e15e6eff879d6b26cff66045e7db76c40c WatchSource:0}: Error finding container 744c0263c8a44d6ee09ef7e96d60d1e15e6eff879d6b26cff66045e7db76c40c: Status 404 returned error can't find the container with id 744c0263c8a44d6ee09ef7e96d60d1e15e6eff879d6b26cff66045e7db76c40c Jun 02 19:08:25.392999 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:25.392947 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp4vh" event={"ID":"295b2bad-5e16-438c-a93c-651780b57362","Type":"ContainerStarted","Data":"744c0263c8a44d6ee09ef7e96d60d1e15e6eff879d6b26cff66045e7db76c40c"} Jun 02 19:08:29.406589 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:29.406544 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp4vh" event={"ID":"295b2bad-5e16-438c-a93c-651780b57362","Type":"ContainerStarted","Data":"05a234fb24f505e5faea3cccb60757aa6acb3afd83e8fc70b22303f2d5bbed2c"} Jun 02 19:08:29.429804 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:29.429738 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bp4vh" podStartSLOduration=0.953733055 podStartE2EDuration="5.429718659s" podCreationTimestamp="2026-06-02 19:08:24 +0000 UTC" firstStartedPulling="2026-06-02 19:08:24.527382057 +0000 UTC m=+274.645185769" lastFinishedPulling="2026-06-02 19:08:29.003367661 +0000 UTC m=+279.121171373" observedRunningTime="2026-06-02 19:08:29.428058037 +0000 UTC m=+279.545861784" watchObservedRunningTime="2026-06-02 19:08:29.429718659 +0000 UTC m=+279.547522393" Jun 02 19:08:50.406729 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:50.406680 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:08:50.407328 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:50.406894 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:08:50.409617 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:08:50.409595 2582 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 19:09:26.639902 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.639867 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg"] Jun 02 19:09:26.642125 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.642106 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.644789 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.644772 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 19:09:26.646038 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.646017 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 19:09:26.646146 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.646077 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hwsg\"" Jun 02 19:09:26.656884 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.656863 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg"] Jun 02 19:09:26.787048 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.786996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z94q\" (UniqueName: \"kubernetes.io/projected/794d57cf-f805-40c0-a429-694c09b3e079-kube-api-access-7z94q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.787048 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.787060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.787257 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.787135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.887538 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.887494 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.887669 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.887558 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z94q\" (UniqueName: \"kubernetes.io/projected/794d57cf-f805-40c0-a429-694c09b3e079-kube-api-access-7z94q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.887669 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.887595 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.887888 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.887860 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.887936 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.887887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.898277 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.898218 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z94q\" (UniqueName: \"kubernetes.io/projected/794d57cf-f805-40c0-a429-694c09b3e079-kube-api-access-7z94q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:26.950828 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:26.950793 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:27.080734 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:27.080685 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg"] Jun 02 19:09:27.084206 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:09:27.084179 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794d57cf_f805_40c0_a429_694c09b3e079.slice/crio-718f6d005ce575b0d83329447503b1649e968c536c08dbec4c0ee9df817c7789 WatchSource:0}: Error finding container 718f6d005ce575b0d83329447503b1649e968c536c08dbec4c0ee9df817c7789: Status 404 returned error can't find the container with id 718f6d005ce575b0d83329447503b1649e968c536c08dbec4c0ee9df817c7789 Jun 02 19:09:27.086341 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:27.086325 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:09:27.567390 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:27.567355 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" event={"ID":"794d57cf-f805-40c0-a429-694c09b3e079","Type":"ContainerStarted","Data":"718f6d005ce575b0d83329447503b1649e968c536c08dbec4c0ee9df817c7789"} Jun 02 19:09:30.994290 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:30.994258 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z89hp"] Jun 02 19:09:30.996586 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:30.996571 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.000152 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.000078 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 19:09:31.001465 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.001446 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 19:09:31.001571 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.001449 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fgkc9\"" Jun 02 19:09:31.007782 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.007755 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z89hp"] Jun 02 19:09:31.125667 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.125630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvq58\" (UniqueName: \"kubernetes.io/projected/883bf025-b263-4c7b-9f33-d972a3068f2e-kube-api-access-zvq58\") pod \"cert-manager-cainjector-68b757865b-z89hp\" (UID: \"883bf025-b263-4c7b-9f33-d972a3068f2e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.125931 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.125685 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/883bf025-b263-4c7b-9f33-d972a3068f2e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z89hp\" (UID: \"883bf025-b263-4c7b-9f33-d972a3068f2e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.226168 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.226134 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvq58\" (UniqueName: \"kubernetes.io/projected/883bf025-b263-4c7b-9f33-d972a3068f2e-kube-api-access-zvq58\") pod \"cert-manager-cainjector-68b757865b-z89hp\" (UID: \"883bf025-b263-4c7b-9f33-d972a3068f2e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.226355 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.226181 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/883bf025-b263-4c7b-9f33-d972a3068f2e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z89hp\" (UID: \"883bf025-b263-4c7b-9f33-d972a3068f2e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.235410 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.235384 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/883bf025-b263-4c7b-9f33-d972a3068f2e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-z89hp\" (UID: \"883bf025-b263-4c7b-9f33-d972a3068f2e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.235557 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.235535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvq58\" (UniqueName: \"kubernetes.io/projected/883bf025-b263-4c7b-9f33-d972a3068f2e-kube-api-access-zvq58\") pod \"cert-manager-cainjector-68b757865b-z89hp\" (UID: \"883bf025-b263-4c7b-9f33-d972a3068f2e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.307152 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.307077 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" Jun 02 19:09:31.452229 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.452200 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-z89hp"] Jun 02 19:09:31.455011 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:09:31.454979 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod883bf025_b263_4c7b_9f33_d972a3068f2e.slice/crio-e2de449dfead2fa9fe75ea3bfea24b5824607a3f8d35eeb6a1e2cc9f6af846e9 WatchSource:0}: Error finding container e2de449dfead2fa9fe75ea3bfea24b5824607a3f8d35eeb6a1e2cc9f6af846e9: Status 404 returned error can't find the container with id e2de449dfead2fa9fe75ea3bfea24b5824607a3f8d35eeb6a1e2cc9f6af846e9 Jun 02 19:09:31.578628 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:31.578590 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" event={"ID":"883bf025-b263-4c7b-9f33-d972a3068f2e","Type":"ContainerStarted","Data":"e2de449dfead2fa9fe75ea3bfea24b5824607a3f8d35eeb6a1e2cc9f6af846e9"} Jun 02 19:09:35.591625 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:35.591591 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" event={"ID":"883bf025-b263-4c7b-9f33-d972a3068f2e","Type":"ContainerStarted","Data":"029739c49062c00a3313ac7f6af687ba5bdf6d73fa07e290b2f25dcdfdb4b6fa"} Jun 02 19:09:35.593054 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:35.593027 2582 generic.go:358] "Generic (PLEG): container finished" podID="794d57cf-f805-40c0-a429-694c09b3e079" containerID="31d8403f11402371a2b62feec92339504a7db737ebfabb8c04abfb03395e5064" exitCode=0 Jun 02 19:09:35.593179 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:35.593067 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" event={"ID":"794d57cf-f805-40c0-a429-694c09b3e079","Type":"ContainerDied","Data":"31d8403f11402371a2b62feec92339504a7db737ebfabb8c04abfb03395e5064"} Jun 02 19:09:35.615885 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:35.615833 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-z89hp" podStartSLOduration=1.674221491 podStartE2EDuration="5.615817323s" podCreationTimestamp="2026-06-02 19:09:30 +0000 UTC" firstStartedPulling="2026-06-02 19:09:31.457233595 +0000 UTC m=+341.575037321" lastFinishedPulling="2026-06-02 19:09:35.398829426 +0000 UTC m=+345.516633153" observedRunningTime="2026-06-02 19:09:35.614650455 +0000 UTC m=+345.732454189" watchObservedRunningTime="2026-06-02 19:09:35.615817323 +0000 UTC m=+345.733621056" Jun 02 19:09:38.602219 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:38.602181 2582 generic.go:358] "Generic (PLEG): container finished" podID="794d57cf-f805-40c0-a429-694c09b3e079" containerID="8fc9afa8e51165872f54c7df4ce16b2321928e812b3ca306c0fa035a056e4b1e" exitCode=0 Jun 02 19:09:38.602582 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:38.602269 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" event={"ID":"794d57cf-f805-40c0-a429-694c09b3e079","Type":"ContainerDied","Data":"8fc9afa8e51165872f54c7df4ce16b2321928e812b3ca306c0fa035a056e4b1e"} Jun 02 19:09:46.629019 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:46.628978 2582 generic.go:358] "Generic (PLEG): container finished" podID="794d57cf-f805-40c0-a429-694c09b3e079" containerID="8e58cbf7f5ede323b89aec2535fcd40572c9d3d10ac4c7ddffa9cf14d680f548" exitCode=0 Jun 02 19:09:46.629394 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:46.629060 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" event={"ID":"794d57cf-f805-40c0-a429-694c09b3e079","Type":"ContainerDied","Data":"8e58cbf7f5ede323b89aec2535fcd40572c9d3d10ac4c7ddffa9cf14d680f548"} Jun 02 19:09:47.752102 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.752071 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:09:47.867561 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.867525 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z94q\" (UniqueName: \"kubernetes.io/projected/794d57cf-f805-40c0-a429-694c09b3e079-kube-api-access-7z94q\") pod \"794d57cf-f805-40c0-a429-694c09b3e079\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " Jun 02 19:09:47.867730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.867580 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-bundle\") pod \"794d57cf-f805-40c0-a429-694c09b3e079\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " Jun 02 19:09:47.867730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.867641 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-util\") pod \"794d57cf-f805-40c0-a429-694c09b3e079\" (UID: \"794d57cf-f805-40c0-a429-694c09b3e079\") " Jun 02 19:09:47.867971 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.867945 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-bundle" (OuterVolumeSpecName: "bundle") pod "794d57cf-f805-40c0-a429-694c09b3e079" (UID: "794d57cf-f805-40c0-a429-694c09b3e079"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:09:47.869742 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.869719 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794d57cf-f805-40c0-a429-694c09b3e079-kube-api-access-7z94q" (OuterVolumeSpecName: "kube-api-access-7z94q") pod "794d57cf-f805-40c0-a429-694c09b3e079" (UID: "794d57cf-f805-40c0-a429-694c09b3e079"). InnerVolumeSpecName "kube-api-access-7z94q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:09:47.873571 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.873544 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-util" (OuterVolumeSpecName: "util") pod "794d57cf-f805-40c0-a429-694c09b3e079" (UID: "794d57cf-f805-40c0-a429-694c09b3e079"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:09:47.968811 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.968728 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:09:47.968811 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.968756 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z94q\" (UniqueName: \"kubernetes.io/projected/794d57cf-f805-40c0-a429-694c09b3e079-kube-api-access-7z94q\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:09:47.968811 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:47.968766 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794d57cf-f805-40c0-a429-694c09b3e079-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:09:48.635789 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:48.635750 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" event={"ID":"794d57cf-f805-40c0-a429-694c09b3e079","Type":"ContainerDied","Data":"718f6d005ce575b0d83329447503b1649e968c536c08dbec4c0ee9df817c7789"} Jun 02 19:09:48.635789 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:48.635784 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="718f6d005ce575b0d83329447503b1649e968c536c08dbec4c0ee9df817c7789" Jun 02 19:09:48.635983 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:09:48.635809 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcvgxg" Jun 02 19:10:14.299292 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299258 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh"] Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299515 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="pull" Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299526 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="pull" Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299541 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="extract" Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299548 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="extract" Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299562 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="util" Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299567 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="util" Jun 02 19:10:14.299800 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.299607 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="794d57cf-f805-40c0-a429-694c09b3e079" containerName="extract" Jun 02 19:10:14.301488 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.301474 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.305185 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.305152 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 19:10:14.305334 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.305185 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 19:10:14.305334 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.305232 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 19:10:14.305466 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.305360 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 19:10:14.305579 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.305566 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xpjmn\"" Jun 02 19:10:14.317947 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.317918 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh"] Jun 02 19:10:14.346992 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.346953 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dff039bc-5df8-40d9-ad6a-87d6567723a4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.347172 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.347046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xc2w\" (UniqueName: \"kubernetes.io/projected/dff039bc-5df8-40d9-ad6a-87d6567723a4-kube-api-access-6xc2w\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.347172 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.347077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dff039bc-5df8-40d9-ad6a-87d6567723a4-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.347172 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.347104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dff039bc-5df8-40d9-ad6a-87d6567723a4-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.347330 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.347174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dff039bc-5df8-40d9-ad6a-87d6567723a4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.447930 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.447884 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xc2w\" (UniqueName: \"kubernetes.io/projected/dff039bc-5df8-40d9-ad6a-87d6567723a4-kube-api-access-6xc2w\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.448125 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.447964 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dff039bc-5df8-40d9-ad6a-87d6567723a4-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.448125 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.447985 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dff039bc-5df8-40d9-ad6a-87d6567723a4-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.448125 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.448027 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dff039bc-5df8-40d9-ad6a-87d6567723a4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.448125 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.448064 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dff039bc-5df8-40d9-ad6a-87d6567723a4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.448411 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.448374 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dff039bc-5df8-40d9-ad6a-87d6567723a4-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.450212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.450192 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dff039bc-5df8-40d9-ad6a-87d6567723a4-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.450582 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.450558 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dff039bc-5df8-40d9-ad6a-87d6567723a4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.450643 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.450624 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dff039bc-5df8-40d9-ad6a-87d6567723a4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.468482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.468454 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xc2w\" (UniqueName: \"kubernetes.io/projected/dff039bc-5df8-40d9-ad6a-87d6567723a4-kube-api-access-6xc2w\") pod \"opendatahub-operator-controller-manager-7548bb679b-2d2gh\" (UID: \"dff039bc-5df8-40d9-ad6a-87d6567723a4\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.611383 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.611338 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:14.764211 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:14.764173 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh"] Jun 02 19:10:14.768240 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:14.768212 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff039bc_5df8_40d9_ad6a_87d6567723a4.slice/crio-d18e70e17d48ab22d62fb36c4def2216f2865863be933a934ea6fd58ba154b2f WatchSource:0}: Error finding container d18e70e17d48ab22d62fb36c4def2216f2865863be933a934ea6fd58ba154b2f: Status 404 returned error can't find the container with id d18e70e17d48ab22d62fb36c4def2216f2865863be933a934ea6fd58ba154b2f Jun 02 19:10:15.714683 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:15.714635 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" event={"ID":"dff039bc-5df8-40d9-ad6a-87d6567723a4","Type":"ContainerStarted","Data":"d18e70e17d48ab22d62fb36c4def2216f2865863be933a934ea6fd58ba154b2f"} Jun 02 19:10:17.721101 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:17.721059 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" event={"ID":"dff039bc-5df8-40d9-ad6a-87d6567723a4","Type":"ContainerStarted","Data":"86f54ad93b2997f86535ebd73405b66839ea4642561a095dda54eb65ab7423ef"} Jun 02 19:10:18.727404 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:18.727366 2582 generic.go:358] "Generic (PLEG): container finished" podID="dff039bc-5df8-40d9-ad6a-87d6567723a4" containerID="86f54ad93b2997f86535ebd73405b66839ea4642561a095dda54eb65ab7423ef" exitCode=0 Jun 02 19:10:18.727797 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:18.727441 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" event={"ID":"dff039bc-5df8-40d9-ad6a-87d6567723a4","Type":"ContainerDied","Data":"86f54ad93b2997f86535ebd73405b66839ea4642561a095dda54eb65ab7423ef"} Jun 02 19:10:19.732218 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:19.732182 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" event={"ID":"dff039bc-5df8-40d9-ad6a-87d6567723a4","Type":"ContainerStarted","Data":"029062ef22716d683a33ee94323116751defe159c7833f01a83e6018694c20b4"} Jun 02 19:10:19.732629 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:19.732293 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:19.755226 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:19.755173 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" podStartSLOduration=1.31703829 podStartE2EDuration="5.755159118s" podCreationTimestamp="2026-06-02 19:10:14 +0000 UTC" firstStartedPulling="2026-06-02 19:10:14.769789934 +0000 UTC m=+384.887593646" lastFinishedPulling="2026-06-02 19:10:19.207910759 +0000 UTC m=+389.325714474" observedRunningTime="2026-06-02 19:10:19.752904034 +0000 UTC m=+389.870707768" watchObservedRunningTime="2026-06-02 19:10:19.755159118 +0000 UTC m=+389.872962853" Jun 02 19:10:30.738156 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:30.738124 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-2d2gh" Jun 02 19:10:33.453797 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.453757 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79d759cb56-jscmc"] Jun 02 19:10:33.459418 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.459394 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.462303 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.462280 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 19:10:33.462423 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.462282 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 19:10:33.462522 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.462507 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 19:10:33.462565 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.462545 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 19:10:33.473636 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.473609 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79d759cb56-jscmc"] Jun 02 19:10:33.494410 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.494377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9tkx\" (UniqueName: \"kubernetes.io/projected/b3e0a33d-ac93-4a1b-a84f-f953818a536b-kube-api-access-n9tkx\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.494567 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.494434 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tmp\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.494567 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.494466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tls-certs\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.574192 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.574158 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff"] Jun 02 19:10:33.576789 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.576774 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.579601 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.579581 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 19:10:33.579745 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.579581 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 19:10:33.579745 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.579615 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hwsg\"" Jun 02 19:10:33.585405 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.585382 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff"] Jun 02 19:10:33.595090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.595066 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9tkx\" (UniqueName: \"kubernetes.io/projected/b3e0a33d-ac93-4a1b-a84f-f953818a536b-kube-api-access-n9tkx\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.595196 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.595124 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tmp\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.595196 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.595162 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tls-certs\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.595284 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:10:33.595270 2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 02 19:10:33.595352 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:10:33.595342 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tls-certs podName:b3e0a33d-ac93-4a1b-a84f-f953818a536b nodeName:}" failed. No retries permitted until 2026-06-02 19:10:34.095323336 +0000 UTC m=+404.213127051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tls-certs") pod "kube-auth-proxy-79d759cb56-jscmc" (UID: "b3e0a33d-ac93-4a1b-a84f-f953818a536b") : secret "kube-auth-proxy-tls" not found Jun 02 19:10:33.597462 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.597429 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tmp\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.605282 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.605248 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9tkx\" (UniqueName: \"kubernetes.io/projected/b3e0a33d-ac93-4a1b-a84f-f953818a536b-kube-api-access-n9tkx\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:33.673251 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.673202 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-xwp7b"] Jun 02 19:10:33.675505 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.675487 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:33.678252 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.678222 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-stdnt\"" Jun 02 19:10:33.678600 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.678583 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 19:10:33.685602 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.685580 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-xwp7b"] Jun 02 19:10:33.695877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.695848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.696008 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.695898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.696008 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.695992 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9rwl\" (UniqueName: \"kubernetes.io/projected/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-kube-api-access-r9rwl\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.797228 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797110 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.797228 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4333b569-7ec2-42db-a99c-f61acf4c4db4-cert\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:33.797228 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797219 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.797498 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797322 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9rwl\" (UniqueName: \"kubernetes.io/projected/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-kube-api-access-r9rwl\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.797498 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqdt\" (UniqueName: \"kubernetes.io/projected/4333b569-7ec2-42db-a99c-f61acf4c4db4-kube-api-access-5cqdt\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:33.797581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797529 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.797581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.797544 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.811904 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.811870 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9rwl\" (UniqueName: \"kubernetes.io/projected/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-kube-api-access-r9rwl\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.886956 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.886915 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:33.897922 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.897893 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqdt\" (UniqueName: \"kubernetes.io/projected/4333b569-7ec2-42db-a99c-f61acf4c4db4-kube-api-access-5cqdt\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:33.898075 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.897942 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4333b569-7ec2-42db-a99c-f61acf4c4db4-cert\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:33.898075 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:10:33.898070 2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 19:10:33.898197 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:10:33.898129 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4333b569-7ec2-42db-a99c-f61acf4c4db4-cert podName:4333b569-7ec2-42db-a99c-f61acf4c4db4 nodeName:}" failed. No retries permitted until 2026-06-02 19:10:34.398110149 +0000 UTC m=+404.515913879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4333b569-7ec2-42db-a99c-f61acf4c4db4-cert") pod "odh-model-controller-76588b95-xwp7b" (UID: "4333b569-7ec2-42db-a99c-f61acf4c4db4") : secret "odh-model-controller-webhook-cert" not found Jun 02 19:10:33.908854 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:33.908826 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqdt\" (UniqueName: \"kubernetes.io/projected/4333b569-7ec2-42db-a99c-f61acf4c4db4-kube-api-access-5cqdt\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:34.099141 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.099106 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tls-certs\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:34.101676 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.101647 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e0a33d-ac93-4a1b-a84f-f953818a536b-tls-certs\") pod \"kube-auth-proxy-79d759cb56-jscmc\" (UID: \"b3e0a33d-ac93-4a1b-a84f-f953818a536b\") " pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:34.230681 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.230646 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff"] Jun 02 19:10:34.234074 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:34.234046 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe26d4e_5ba2_491f_bc8d_4aa6654c8268.slice/crio-1aa4308c50748a3a3b32b95e3e287da78041901e6aca95893218f47f48c98679 WatchSource:0}: Error finding container 1aa4308c50748a3a3b32b95e3e287da78041901e6aca95893218f47f48c98679: Status 404 returned error can't find the container with id 1aa4308c50748a3a3b32b95e3e287da78041901e6aca95893218f47f48c98679 Jun 02 19:10:34.368527 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.368440 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" Jun 02 19:10:34.402167 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.402013 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4333b569-7ec2-42db-a99c-f61acf4c4db4-cert\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:34.405242 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.405209 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4333b569-7ec2-42db-a99c-f61acf4c4db4-cert\") pod \"odh-model-controller-76588b95-xwp7b\" (UID: \"4333b569-7ec2-42db-a99c-f61acf4c4db4\") " pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:34.456845 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.456809 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-9xzgg"] Jun 02 19:10:34.462498 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.462465 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:34.465504 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.465464 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 19:10:34.465785 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.465762 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nh9ln\"" Jun 02 19:10:34.473904 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.473874 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-9xzgg"] Jun 02 19:10:34.502411 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.502380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66vkc\" (UniqueName: \"kubernetes.io/projected/4fa76471-cab6-4da5-8f41-26db170bcca5-kube-api-access-66vkc\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:34.502553 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.502448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa76471-cab6-4da5-8f41-26db170bcca5-tls-certs\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:34.541846 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.541820 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79d759cb56-jscmc"] Jun 02 19:10:34.544292 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:34.544244 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e0a33d_ac93_4a1b_a84f_f953818a536b.slice/crio-eae821a80b5bb5d9a9af526001c475e9ae9351ced10d4e236a79cc8604bff781 WatchSource:0}: Error finding container eae821a80b5bb5d9a9af526001c475e9ae9351ced10d4e236a79cc8604bff781: Status 404 returned error can't find the container with id eae821a80b5bb5d9a9af526001c475e9ae9351ced10d4e236a79cc8604bff781 Jun 02 19:10:34.586864 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.586831 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:34.603777 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.603745 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66vkc\" (UniqueName: \"kubernetes.io/projected/4fa76471-cab6-4da5-8f41-26db170bcca5-kube-api-access-66vkc\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:34.603913 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.603828 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa76471-cab6-4da5-8f41-26db170bcca5-tls-certs\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:34.603968 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:10:34.603953 2582 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 19:10:34.604043 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:10:34.604031 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fa76471-cab6-4da5-8f41-26db170bcca5-tls-certs podName:4fa76471-cab6-4da5-8f41-26db170bcca5 nodeName:}" failed. No retries permitted until 2026-06-02 19:10:35.104007355 +0000 UTC m=+405.221811082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4fa76471-cab6-4da5-8f41-26db170bcca5-tls-certs") pod "model-serving-api-6577596cd5-9xzgg" (UID: "4fa76471-cab6-4da5-8f41-26db170bcca5") : secret "model-serving-api-tls" not found Jun 02 19:10:34.616582 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.616542 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66vkc\" (UniqueName: \"kubernetes.io/projected/4fa76471-cab6-4da5-8f41-26db170bcca5-kube-api-access-66vkc\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:34.710958 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.710935 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-xwp7b"] Jun 02 19:10:34.713223 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:34.713192 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4333b569_7ec2_42db_a99c_f61acf4c4db4.slice/crio-7472315b3722e53e3002e01c03095e940a477d1e0d9d351f461970b054fc195a WatchSource:0}: Error finding container 7472315b3722e53e3002e01c03095e940a477d1e0d9d351f461970b054fc195a: Status 404 returned error can't find the container with id 7472315b3722e53e3002e01c03095e940a477d1e0d9d351f461970b054fc195a Jun 02 19:10:34.777244 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.777208 2582 generic.go:358] "Generic (PLEG): container finished" podID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerID="f4f3d2c959362d68500d918ebf3737d4b7a79a23b1637b7c86ae6a8ca896b1e7" exitCode=0 Jun 02 19:10:34.777386 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.777286 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" event={"ID":"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268","Type":"ContainerDied","Data":"f4f3d2c959362d68500d918ebf3737d4b7a79a23b1637b7c86ae6a8ca896b1e7"} Jun 02 19:10:34.777386 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.777333 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" event={"ID":"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268","Type":"ContainerStarted","Data":"1aa4308c50748a3a3b32b95e3e287da78041901e6aca95893218f47f48c98679"} Jun 02 19:10:34.778387 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.778365 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-xwp7b" event={"ID":"4333b569-7ec2-42db-a99c-f61acf4c4db4","Type":"ContainerStarted","Data":"7472315b3722e53e3002e01c03095e940a477d1e0d9d351f461970b054fc195a"} Jun 02 19:10:34.779398 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:34.779377 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" event={"ID":"b3e0a33d-ac93-4a1b-a84f-f953818a536b","Type":"ContainerStarted","Data":"eae821a80b5bb5d9a9af526001c475e9ae9351ced10d4e236a79cc8604bff781"} Jun 02 19:10:35.108832 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.108790 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa76471-cab6-4da5-8f41-26db170bcca5-tls-certs\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:35.111432 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.111399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fa76471-cab6-4da5-8f41-26db170bcca5-tls-certs\") pod \"model-serving-api-6577596cd5-9xzgg\" (UID: \"4fa76471-cab6-4da5-8f41-26db170bcca5\") " pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:35.378352 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.378268 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:35.553895 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.553836 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-9xzgg"] Jun 02 19:10:35.559056 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:35.559027 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa76471_cab6_4da5_8f41_26db170bcca5.slice/crio-6ef348e840dd43d3e16bb5a5f1a582a1e3279cfd09f9311006d082cfa13fe981 WatchSource:0}: Error finding container 6ef348e840dd43d3e16bb5a5f1a582a1e3279cfd09f9311006d082cfa13fe981: Status 404 returned error can't find the container with id 6ef348e840dd43d3e16bb5a5f1a582a1e3279cfd09f9311006d082cfa13fe981 Jun 02 19:10:35.787019 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.786909 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" event={"ID":"4fa76471-cab6-4da5-8f41-26db170bcca5","Type":"ContainerStarted","Data":"6ef348e840dd43d3e16bb5a5f1a582a1e3279cfd09f9311006d082cfa13fe981"} Jun 02 19:10:35.790805 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.790721 2582 generic.go:358] "Generic (PLEG): container finished" podID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerID="cdedbde5f22652876155149e0ee1221b115cef3adabca52dc4dc934ff63e9997" exitCode=0 Jun 02 19:10:35.790805 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:35.790768 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" event={"ID":"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268","Type":"ContainerDied","Data":"cdedbde5f22652876155149e0ee1221b115cef3adabca52dc4dc934ff63e9997"} Jun 02 19:10:36.797849 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:36.797800 2582 generic.go:358] "Generic (PLEG): container finished" podID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerID="cd6fd59dc32cbd0596de516530a1d93b61f495640c763d952087425edb659841" exitCode=0 Jun 02 19:10:36.797849 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:36.797848 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" event={"ID":"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268","Type":"ContainerDied","Data":"cd6fd59dc32cbd0596de516530a1d93b61f495640c763d952087425edb659841"} Jun 02 19:10:38.386254 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.386225 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:38.440009 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.439976 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-bundle\") pod \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " Jun 02 19:10:38.440183 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.440087 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9rwl\" (UniqueName: \"kubernetes.io/projected/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-kube-api-access-r9rwl\") pod \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " Jun 02 19:10:38.440183 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.440126 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-util\") pod \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\" (UID: \"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268\") " Jun 02 19:10:38.441010 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.440959 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-bundle" (OuterVolumeSpecName: "bundle") pod "bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" (UID: "bfe26d4e-5ba2-491f-bc8d-4aa6654c8268"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:38.442656 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.442621 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-kube-api-access-r9rwl" (OuterVolumeSpecName: "kube-api-access-r9rwl") pod "bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" (UID: "bfe26d4e-5ba2-491f-bc8d-4aa6654c8268"). InnerVolumeSpecName "kube-api-access-r9rwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:10:38.445522 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.445477 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-util" (OuterVolumeSpecName: "util") pod "bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" (UID: "bfe26d4e-5ba2-491f-bc8d-4aa6654c8268"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:38.541544 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.541508 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9rwl\" (UniqueName: \"kubernetes.io/projected/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-kube-api-access-r9rwl\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:10:38.541544 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.541543 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:10:38.541544 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.541555 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfe26d4e-5ba2-491f-bc8d-4aa6654c8268-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:10:38.810658 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.810561 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" event={"ID":"bfe26d4e-5ba2-491f-bc8d-4aa6654c8268","Type":"ContainerDied","Data":"1aa4308c50748a3a3b32b95e3e287da78041901e6aca95893218f47f48c98679"} Jun 02 19:10:38.810658 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.810609 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r8rff" Jun 02 19:10:38.810903 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:38.810612 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1aa4308c50748a3a3b32b95e3e287da78041901e6aca95893218f47f48c98679" Jun 02 19:10:39.815299 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.815261 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-xwp7b" event={"ID":"4333b569-7ec2-42db-a99c-f61acf4c4db4","Type":"ContainerStarted","Data":"d768b41cabd164aae445591ede132d90cbb88b1f40feba093bd1a55e454639f3"} Jun 02 19:10:39.815908 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.815496 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:39.816597 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.816573 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" event={"ID":"b3e0a33d-ac93-4a1b-a84f-f953818a536b","Type":"ContainerStarted","Data":"8c3fa453991d7107408c720ee4dbaf45bf2ca68d768849e51683a807a42729b4"} Jun 02 19:10:39.817727 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.817705 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" event={"ID":"4fa76471-cab6-4da5-8f41-26db170bcca5","Type":"ContainerStarted","Data":"ffb3d45760bd83413c90f7812fa92ee864f28ea41fbb4cb208264c03fa214e53"} Jun 02 19:10:39.817829 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.817810 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:39.832135 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.832072 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-xwp7b" podStartSLOduration=2.296748778 podStartE2EDuration="6.832053492s" podCreationTimestamp="2026-06-02 19:10:33 +0000 UTC" firstStartedPulling="2026-06-02 19:10:34.714535095 +0000 UTC m=+404.832338806" lastFinishedPulling="2026-06-02 19:10:39.249839808 +0000 UTC m=+409.367643520" observedRunningTime="2026-06-02 19:10:39.831068942 +0000 UTC m=+409.948872676" watchObservedRunningTime="2026-06-02 19:10:39.832053492 +0000 UTC m=+409.949857227" Jun 02 19:10:39.847874 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.847814 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79d759cb56-jscmc" podStartSLOduration=2.149717283 podStartE2EDuration="6.847799456s" podCreationTimestamp="2026-06-02 19:10:33 +0000 UTC" firstStartedPulling="2026-06-02 19:10:34.546061805 +0000 UTC m=+404.663865520" lastFinishedPulling="2026-06-02 19:10:39.244143962 +0000 UTC m=+409.361947693" observedRunningTime="2026-06-02 19:10:39.84700162 +0000 UTC m=+409.964805354" watchObservedRunningTime="2026-06-02 19:10:39.847799456 +0000 UTC m=+409.965603189" Jun 02 19:10:39.864496 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:39.864443 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" podStartSLOduration=2.171366234 podStartE2EDuration="5.864425603s" podCreationTimestamp="2026-06-02 19:10:34 +0000 UTC" firstStartedPulling="2026-06-02 19:10:35.561231759 +0000 UTC m=+405.679035484" lastFinishedPulling="2026-06-02 19:10:39.254291137 +0000 UTC m=+409.372094853" observedRunningTime="2026-06-02 19:10:39.863897858 +0000 UTC m=+409.981701587" watchObservedRunningTime="2026-06-02 19:10:39.864425603 +0000 UTC m=+409.982229338" Jun 02 19:10:43.051472 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051429 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-dl469"] Jun 02 19:10:43.051954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051849 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="extract" Jun 02 19:10:43.051954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051867 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="extract" Jun 02 19:10:43.051954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051891 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="pull" Jun 02 19:10:43.051954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051900 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="pull" Jun 02 19:10:43.051954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051912 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="util" Jun 02 19:10:43.051954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051919 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="util" Jun 02 19:10:43.052234 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.051995 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bfe26d4e-5ba2-491f-bc8d-4aa6654c8268" containerName="extract" Jun 02 19:10:43.055013 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.054992 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.058438 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.058414 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xfd98\"" Jun 02 19:10:43.058663 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.058640 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 19:10:43.067712 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.067659 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-dl469"] Jun 02 19:10:43.077037 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.076861 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c"] Jun 02 19:10:43.081941 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.081513 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.085054 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.085026 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 19:10:43.085338 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.085301 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hvrqc\"" Jun 02 19:10:43.087540 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.087522 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c"] Jun 02 19:10:43.177884 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.177850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dae57c58-0eec-46a5-ad95-53a46b2cd93d-cert\") pod \"llmisvc-controller-manager-c6b9847d7-2gc5c\" (UID: \"dae57c58-0eec-46a5-ad95-53a46b2cd93d\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.178088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.177921 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdaf7970-3491-4095-b79d-86247de42ef8-cert\") pod \"kserve-controller-manager-7c99ffcdcd-dl469\" (UID: \"bdaf7970-3491-4095-b79d-86247de42ef8\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.178088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.177980 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2btj5\" (UniqueName: \"kubernetes.io/projected/bdaf7970-3491-4095-b79d-86247de42ef8-kube-api-access-2btj5\") pod \"kserve-controller-manager-7c99ffcdcd-dl469\" (UID: \"bdaf7970-3491-4095-b79d-86247de42ef8\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.178088 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.178008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56vpb\" (UniqueName: \"kubernetes.io/projected/dae57c58-0eec-46a5-ad95-53a46b2cd93d-kube-api-access-56vpb\") pod \"llmisvc-controller-manager-c6b9847d7-2gc5c\" (UID: \"dae57c58-0eec-46a5-ad95-53a46b2cd93d\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.278499 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.278463 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2btj5\" (UniqueName: \"kubernetes.io/projected/bdaf7970-3491-4095-b79d-86247de42ef8-kube-api-access-2btj5\") pod \"kserve-controller-manager-7c99ffcdcd-dl469\" (UID: \"bdaf7970-3491-4095-b79d-86247de42ef8\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.278499 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.278499 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56vpb\" (UniqueName: \"kubernetes.io/projected/dae57c58-0eec-46a5-ad95-53a46b2cd93d-kube-api-access-56vpb\") pod \"llmisvc-controller-manager-c6b9847d7-2gc5c\" (UID: \"dae57c58-0eec-46a5-ad95-53a46b2cd93d\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.278808 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.278521 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dae57c58-0eec-46a5-ad95-53a46b2cd93d-cert\") pod \"llmisvc-controller-manager-c6b9847d7-2gc5c\" (UID: \"dae57c58-0eec-46a5-ad95-53a46b2cd93d\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.278808 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.278553 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdaf7970-3491-4095-b79d-86247de42ef8-cert\") pod \"kserve-controller-manager-7c99ffcdcd-dl469\" (UID: \"bdaf7970-3491-4095-b79d-86247de42ef8\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.281053 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.281016 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdaf7970-3491-4095-b79d-86247de42ef8-cert\") pod \"kserve-controller-manager-7c99ffcdcd-dl469\" (UID: \"bdaf7970-3491-4095-b79d-86247de42ef8\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.281156 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.281067 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dae57c58-0eec-46a5-ad95-53a46b2cd93d-cert\") pod \"llmisvc-controller-manager-c6b9847d7-2gc5c\" (UID: \"dae57c58-0eec-46a5-ad95-53a46b2cd93d\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.292029 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.292004 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2btj5\" (UniqueName: \"kubernetes.io/projected/bdaf7970-3491-4095-b79d-86247de42ef8-kube-api-access-2btj5\") pod \"kserve-controller-manager-7c99ffcdcd-dl469\" (UID: \"bdaf7970-3491-4095-b79d-86247de42ef8\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.292153 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.292104 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56vpb\" (UniqueName: \"kubernetes.io/projected/dae57c58-0eec-46a5-ad95-53a46b2cd93d-kube-api-access-56vpb\") pod \"llmisvc-controller-manager-c6b9847d7-2gc5c\" (UID: \"dae57c58-0eec-46a5-ad95-53a46b2cd93d\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.366364 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.366322 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:43.393338 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.393303 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:43.543183 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.543158 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-dl469"] Jun 02 19:10:43.544730 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:43.544681 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddae57c58_0eec_46a5_ad95_53a46b2cd93d.slice/crio-9ee9d592fbb52cb82c85357d437c9a197b8e47791b33a43c342728529f570466 WatchSource:0}: Error finding container 9ee9d592fbb52cb82c85357d437c9a197b8e47791b33a43c342728529f570466: Status 404 returned error can't find the container with id 9ee9d592fbb52cb82c85357d437c9a197b8e47791b33a43c342728529f570466 Jun 02 19:10:43.544971 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.544948 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c"] Jun 02 19:10:43.545638 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:43.545613 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdaf7970_3491_4095_b79d_86247de42ef8.slice/crio-5d357740a34adb56651d78c876c09b608610c8f4fa54a69e2f2db1e31ef0e54c WatchSource:0}: Error finding container 5d357740a34adb56651d78c876c09b608610c8f4fa54a69e2f2db1e31ef0e54c: Status 404 returned error can't find the container with id 5d357740a34adb56651d78c876c09b608610c8f4fa54a69e2f2db1e31ef0e54c Jun 02 19:10:43.831443 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.831407 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" event={"ID":"bdaf7970-3491-4095-b79d-86247de42ef8","Type":"ContainerStarted","Data":"5d357740a34adb56651d78c876c09b608610c8f4fa54a69e2f2db1e31ef0e54c"} Jun 02 19:10:43.832359 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:43.832340 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" event={"ID":"dae57c58-0eec-46a5-ad95-53a46b2cd93d","Type":"ContainerStarted","Data":"9ee9d592fbb52cb82c85357d437c9a197b8e47791b33a43c342728529f570466"} Jun 02 19:10:46.844504 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:46.844466 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" event={"ID":"dae57c58-0eec-46a5-ad95-53a46b2cd93d","Type":"ContainerStarted","Data":"76b2862e3421336c699b07716538ae1e3db6e26df6bb7e2d503585b192cd2295"} Jun 02 19:10:46.844997 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:46.844608 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:10:47.848636 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:47.848551 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" event={"ID":"bdaf7970-3491-4095-b79d-86247de42ef8","Type":"ContainerStarted","Data":"ecf64f158e1e5b58234e19589d0dd33678ec1a5b458456506ca7ad15a189d518"} Jun 02 19:10:47.849025 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:47.848930 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:10:47.946049 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:47.945991 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" podStartSLOduration=1.7518627759999998 podStartE2EDuration="4.945973469s" podCreationTimestamp="2026-06-02 19:10:43 +0000 UTC" firstStartedPulling="2026-06-02 19:10:43.546120785 +0000 UTC m=+413.663924497" lastFinishedPulling="2026-06-02 19:10:46.740231479 +0000 UTC m=+416.858035190" observedRunningTime="2026-06-02 19:10:46.895132843 +0000 UTC m=+417.012936576" watchObservedRunningTime="2026-06-02 19:10:47.945973469 +0000 UTC m=+418.063777356" Jun 02 19:10:48.201926 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.201744 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" podStartSLOduration=1.160371661 podStartE2EDuration="5.201722035s" podCreationTimestamp="2026-06-02 19:10:43 +0000 UTC" firstStartedPulling="2026-06-02 19:10:43.546954104 +0000 UTC m=+413.664757816" lastFinishedPulling="2026-06-02 19:10:47.588304475 +0000 UTC m=+417.706108190" observedRunningTime="2026-06-02 19:10:47.961024947 +0000 UTC m=+418.078828677" watchObservedRunningTime="2026-06-02 19:10:48.201722035 +0000 UTC m=+418.319525771" Jun 02 19:10:48.203177 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.203154 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72"] Jun 02 19:10:48.244123 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.244090 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72"] Jun 02 19:10:48.244263 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.244219 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.251522 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.251407 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 19:10:48.251660 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.251547 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 19:10:48.252890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.252826 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hwsg\"" Jun 02 19:10:48.327910 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.327870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.328093 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.327926 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.328093 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.327953 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5gjb\" (UniqueName: \"kubernetes.io/projected/4f200def-0244-43ea-a849-b1a4b6e5a35d-kube-api-access-f5gjb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.429319 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.429280 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.429319 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.429320 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5gjb\" (UniqueName: \"kubernetes.io/projected/4f200def-0244-43ea-a849-b1a4b6e5a35d-kube-api-access-f5gjb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.429581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.429380 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.429848 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.429826 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.429848 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.429838 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.449703 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.449666 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5gjb\" (UniqueName: \"kubernetes.io/projected/4f200def-0244-43ea-a849-b1a4b6e5a35d-kube-api-access-f5gjb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.553593 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.553501 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:48.703514 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.703491 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72"] Jun 02 19:10:48.705210 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:48.705176 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f200def_0244_43ea_a849_b1a4b6e5a35d.slice/crio-a1f46f9a30625c6c8b8deb813fcddd5a5e92ec25a9308a3b5644ab8b376cad14 WatchSource:0}: Error finding container a1f46f9a30625c6c8b8deb813fcddd5a5e92ec25a9308a3b5644ab8b376cad14: Status 404 returned error can't find the container with id a1f46f9a30625c6c8b8deb813fcddd5a5e92ec25a9308a3b5644ab8b376cad14 Jun 02 19:10:48.853064 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.853031 2582 generic.go:358] "Generic (PLEG): container finished" podID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerID="ad5ef5de29635f1382b42a9a3a546c3f2d62aea1fe4bf55819bd5027ab097602" exitCode=0 Jun 02 19:10:48.853454 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.853105 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" event={"ID":"4f200def-0244-43ea-a849-b1a4b6e5a35d","Type":"ContainerDied","Data":"ad5ef5de29635f1382b42a9a3a546c3f2d62aea1fe4bf55819bd5027ab097602"} Jun 02 19:10:48.853454 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:48.853138 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" event={"ID":"4f200def-0244-43ea-a849-b1a4b6e5a35d","Type":"ContainerStarted","Data":"a1f46f9a30625c6c8b8deb813fcddd5a5e92ec25a9308a3b5644ab8b376cad14"} Jun 02 19:10:49.860773 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.860733 2582 generic.go:358] "Generic (PLEG): container finished" podID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerID="95165591e3dff35a47170ea82fbad6fd09eb7f1e993b2c653dc8ef850ec12112" exitCode=0 Jun 02 19:10:49.861230 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.860804 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" event={"ID":"4f200def-0244-43ea-a849-b1a4b6e5a35d","Type":"ContainerDied","Data":"95165591e3dff35a47170ea82fbad6fd09eb7f1e993b2c653dc8ef850ec12112"} Jun 02 19:10:49.990127 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.990081 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-46fcg"] Jun 02 19:10:49.993244 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.993219 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:49.996818 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.996788 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 19:10:49.996937 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.996842 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 19:10:49.996937 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:49.996914 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7fbss\"" Jun 02 19:10:50.016205 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.016179 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-46fcg"] Jun 02 19:10:50.145674 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.145647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9slb\" (UniqueName: \"kubernetes.io/projected/7c84d754-de47-4c6a-aaa6-c5d51bc4ba06-kube-api-access-s9slb\") pod \"servicemesh-operator3-55f49c5f94-46fcg\" (UID: \"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.145802 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.145780 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7c84d754-de47-4c6a-aaa6-c5d51bc4ba06-operator-config\") pod \"servicemesh-operator3-55f49c5f94-46fcg\" (UID: \"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.246268 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.246230 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9slb\" (UniqueName: \"kubernetes.io/projected/7c84d754-de47-4c6a-aaa6-c5d51bc4ba06-kube-api-access-s9slb\") pod \"servicemesh-operator3-55f49c5f94-46fcg\" (UID: \"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.246441 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.246314 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7c84d754-de47-4c6a-aaa6-c5d51bc4ba06-operator-config\") pod \"servicemesh-operator3-55f49c5f94-46fcg\" (UID: \"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.248733 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.248704 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7c84d754-de47-4c6a-aaa6-c5d51bc4ba06-operator-config\") pod \"servicemesh-operator3-55f49c5f94-46fcg\" (UID: \"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.255723 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.255676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9slb\" (UniqueName: \"kubernetes.io/projected/7c84d754-de47-4c6a-aaa6-c5d51bc4ba06-kube-api-access-s9slb\") pod \"servicemesh-operator3-55f49c5f94-46fcg\" (UID: \"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.302823 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.302787 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:50.450187 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.450156 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-46fcg"] Jun 02 19:10:50.454012 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:50.453985 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c84d754_de47_4c6a_aaa6_c5d51bc4ba06.slice/crio-0bbdde63709cbdf29e19800167d1c83a2c6f0c65ee91923758368a89f9748d29 WatchSource:0}: Error finding container 0bbdde63709cbdf29e19800167d1c83a2c6f0c65ee91923758368a89f9748d29: Status 404 returned error can't find the container with id 0bbdde63709cbdf29e19800167d1c83a2c6f0c65ee91923758368a89f9748d29 Jun 02 19:10:50.824116 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.824024 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-xwp7b" Jun 02 19:10:50.826092 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.826067 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-9xzgg" Jun 02 19:10:50.866296 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.866258 2582 generic.go:358] "Generic (PLEG): container finished" podID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerID="cb556ffb5f6a976cb9f42d9d763012ce11ad7616412ae80a1b249e83447bf414" exitCode=0 Jun 02 19:10:50.866699 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.866330 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" event={"ID":"4f200def-0244-43ea-a849-b1a4b6e5a35d","Type":"ContainerDied","Data":"cb556ffb5f6a976cb9f42d9d763012ce11ad7616412ae80a1b249e83447bf414"} Jun 02 19:10:50.867434 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:50.867414 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" event={"ID":"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06","Type":"ContainerStarted","Data":"0bbdde63709cbdf29e19800167d1c83a2c6f0c65ee91923758368a89f9748d29"} Jun 02 19:10:52.001644 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.001620 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:52.062002 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.061973 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5gjb\" (UniqueName: \"kubernetes.io/projected/4f200def-0244-43ea-a849-b1a4b6e5a35d-kube-api-access-f5gjb\") pod \"4f200def-0244-43ea-a849-b1a4b6e5a35d\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " Jun 02 19:10:52.062170 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.062065 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-util\") pod \"4f200def-0244-43ea-a849-b1a4b6e5a35d\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " Jun 02 19:10:52.062234 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.062169 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-bundle\") pod \"4f200def-0244-43ea-a849-b1a4b6e5a35d\" (UID: \"4f200def-0244-43ea-a849-b1a4b6e5a35d\") " Jun 02 19:10:52.063292 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.063261 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-bundle" (OuterVolumeSpecName: "bundle") pod "4f200def-0244-43ea-a849-b1a4b6e5a35d" (UID: "4f200def-0244-43ea-a849-b1a4b6e5a35d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:52.064532 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.064490 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f200def-0244-43ea-a849-b1a4b6e5a35d-kube-api-access-f5gjb" (OuterVolumeSpecName: "kube-api-access-f5gjb") pod "4f200def-0244-43ea-a849-b1a4b6e5a35d" (UID: "4f200def-0244-43ea-a849-b1a4b6e5a35d"). InnerVolumeSpecName "kube-api-access-f5gjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:10:52.068749 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.068726 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-util" (OuterVolumeSpecName: "util") pod "4f200def-0244-43ea-a849-b1a4b6e5a35d" (UID: "4f200def-0244-43ea-a849-b1a4b6e5a35d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:52.163114 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.163031 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:10:52.163114 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.163071 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f200def-0244-43ea-a849-b1a4b6e5a35d-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:10:52.163114 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.163087 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5gjb\" (UniqueName: \"kubernetes.io/projected/4f200def-0244-43ea-a849-b1a4b6e5a35d-kube-api-access-f5gjb\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:10:52.879079 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.879045 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" Jun 02 19:10:52.879272 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.879044 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a57c72" event={"ID":"4f200def-0244-43ea-a849-b1a4b6e5a35d","Type":"ContainerDied","Data":"a1f46f9a30625c6c8b8deb813fcddd5a5e92ec25a9308a3b5644ab8b376cad14"} Jun 02 19:10:52.879272 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:52.879165 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1f46f9a30625c6c8b8deb813fcddd5a5e92ec25a9308a3b5644ab8b376cad14" Jun 02 19:10:53.886019 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:53.885201 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" event={"ID":"7c84d754-de47-4c6a-aaa6-c5d51bc4ba06","Type":"ContainerStarted","Data":"14fec323b45a6598e7527ee30c21d8329538051223774f4d2fc3cc1d9496408d"} Jun 02 19:10:53.886019 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:53.885977 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:10:53.912076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:53.912027 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" podStartSLOduration=1.8662283739999999 podStartE2EDuration="4.912012143s" podCreationTimestamp="2026-06-02 19:10:49 +0000 UTC" firstStartedPulling="2026-06-02 19:10:50.457106977 +0000 UTC m=+420.574910689" lastFinishedPulling="2026-06-02 19:10:53.502890732 +0000 UTC m=+423.620694458" observedRunningTime="2026-06-02 19:10:53.909228141 +0000 UTC m=+424.027031877" watchObservedRunningTime="2026-06-02 19:10:53.912012143 +0000 UTC m=+424.029815876" Jun 02 19:10:54.859296 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859258 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86"] Jun 02 19:10:54.859587 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859575 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="extract" Jun 02 19:10:54.859627 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859588 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="extract" Jun 02 19:10:54.859627 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859601 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="util" Jun 02 19:10:54.859627 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859606 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="util" Jun 02 19:10:54.859627 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859614 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="pull" Jun 02 19:10:54.859627 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859619 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="pull" Jun 02 19:10:54.859841 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.859668 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f200def-0244-43ea-a849-b1a4b6e5a35d" containerName="extract" Jun 02 19:10:54.862711 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.862680 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.865888 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.865857 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 19:10:54.865888 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.865857 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 19:10:54.866120 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.866102 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 19:10:54.866214 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.866197 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7wlh5\"" Jun 02 19:10:54.866367 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.866349 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 19:10:54.880360 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.880326 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86"] Jun 02 19:10:54.993127 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-cacerts\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.993127 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7e6b0f-93b6-4a6b-b85c-afd87d644014-local-certs\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.993574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993307 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnpjb\" (UniqueName: \"kubernetes.io/projected/db7e6b0f-93b6-4a6b-b85c-afd87d644014-kube-api-access-rnpjb\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.993574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993347 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.993574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.993574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993398 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:54.993574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:54.993467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-token\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.093921 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.093885 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnpjb\" (UniqueName: \"kubernetes.io/projected/db7e6b0f-93b6-4a6b-b85c-afd87d644014-kube-api-access-rnpjb\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.093921 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.093930 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.094176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.093949 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.094176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.093977 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.094176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.094008 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-token\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.094176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.094044 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-cacerts\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.094176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.094076 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7e6b0f-93b6-4a6b-b85c-afd87d644014-local-certs\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.094684 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.094632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.096581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.096539 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7e6b0f-93b6-4a6b-b85c-afd87d644014-local-certs\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.096581 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.096556 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.096878 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.096859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.097221 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.097202 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7e6b0f-93b6-4a6b-b85c-afd87d644014-cacerts\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.102610 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.102573 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7e6b0f-93b6-4a6b-b85c-afd87d644014-istio-token\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.103294 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.103272 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnpjb\" (UniqueName: \"kubernetes.io/projected/db7e6b0f-93b6-4a6b-b85c-afd87d644014-kube-api-access-rnpjb\") pod \"istiod-openshift-gateway-798958bb55-kjk86\" (UID: \"db7e6b0f-93b6-4a6b-b85c-afd87d644014\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.172212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.172124 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:55.351720 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.351669 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86"] Jun 02 19:10:55.353509 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:10:55.353475 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7e6b0f_93b6_4a6b_b85c_afd87d644014.slice/crio-083ecacdc8b41c0e78824d203d1aaea5dd11fdd9abfd022d9ccb29a64770701e WatchSource:0}: Error finding container 083ecacdc8b41c0e78824d203d1aaea5dd11fdd9abfd022d9ccb29a64770701e: Status 404 returned error can't find the container with id 083ecacdc8b41c0e78824d203d1aaea5dd11fdd9abfd022d9ccb29a64770701e Jun 02 19:10:55.901080 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:55.901048 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" event={"ID":"db7e6b0f-93b6-4a6b-b85c-afd87d644014","Type":"ContainerStarted","Data":"083ecacdc8b41c0e78824d203d1aaea5dd11fdd9abfd022d9ccb29a64770701e"} Jun 02 19:10:58.363185 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:58.363152 2582 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 19:10:58.363444 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:58.363217 2582 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 19:10:58.912965 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:58.912924 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" event={"ID":"db7e6b0f-93b6-4a6b-b85c-afd87d644014","Type":"ContainerStarted","Data":"67c6aea76e0c9723ed30720704ef8cfd0f5d37a314bd8bfc51dd6aacd085a588"} Jun 02 19:10:58.913185 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:58.913057 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:10:58.940146 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:58.940098 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" podStartSLOduration=1.9329972039999999 podStartE2EDuration="4.940085068s" podCreationTimestamp="2026-06-02 19:10:54 +0000 UTC" firstStartedPulling="2026-06-02 19:10:55.35583279 +0000 UTC m=+425.473636502" lastFinishedPulling="2026-06-02 19:10:58.362920651 +0000 UTC m=+428.480724366" observedRunningTime="2026-06-02 19:10:58.93828054 +0000 UTC m=+429.056084274" watchObservedRunningTime="2026-06-02 19:10:58.940085068 +0000 UTC m=+429.057888802" Jun 02 19:10:59.918380 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:10:59.918354 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-kjk86" Jun 02 19:11:03.273772 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.273738 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-76d7946f8d-46gfw"] Jun 02 19:11:03.277072 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.277048 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.279918 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.279895 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 19:11:03.280046 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.280001 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8wlnk\"" Jun 02 19:11:03.287247 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.287218 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76d7946f8d-46gfw"] Jun 02 19:11:03.358302 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.358267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/61fc0352-3d7b-47c6-a753-dc663e95bba4-redirect-config\") pod \"dashboard-redirect-76d7946f8d-46gfw\" (UID: \"61fc0352-3d7b-47c6-a753-dc663e95bba4\") " pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.358464 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.358377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbgf\" (UniqueName: \"kubernetes.io/projected/61fc0352-3d7b-47c6-a753-dc663e95bba4-kube-api-access-qqbgf\") pod \"dashboard-redirect-76d7946f8d-46gfw\" (UID: \"61fc0352-3d7b-47c6-a753-dc663e95bba4\") " pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.459031 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.458988 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbgf\" (UniqueName: \"kubernetes.io/projected/61fc0352-3d7b-47c6-a753-dc663e95bba4-kube-api-access-qqbgf\") pod \"dashboard-redirect-76d7946f8d-46gfw\" (UID: \"61fc0352-3d7b-47c6-a753-dc663e95bba4\") " pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.459031 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.459040 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/61fc0352-3d7b-47c6-a753-dc663e95bba4-redirect-config\") pod \"dashboard-redirect-76d7946f8d-46gfw\" (UID: \"61fc0352-3d7b-47c6-a753-dc663e95bba4\") " pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.459724 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.459705 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/61fc0352-3d7b-47c6-a753-dc663e95bba4-redirect-config\") pod \"dashboard-redirect-76d7946f8d-46gfw\" (UID: \"61fc0352-3d7b-47c6-a753-dc663e95bba4\") " pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.467750 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.467722 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbgf\" (UniqueName: \"kubernetes.io/projected/61fc0352-3d7b-47c6-a753-dc663e95bba4-kube-api-access-qqbgf\") pod \"dashboard-redirect-76d7946f8d-46gfw\" (UID: \"61fc0352-3d7b-47c6-a753-dc663e95bba4\") " pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.588644 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.588612 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" Jun 02 19:11:03.715595 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.715558 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76d7946f8d-46gfw"] Jun 02 19:11:03.718507 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:11:03.718481 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fc0352_3d7b_47c6_a753_dc663e95bba4.slice/crio-d3b249d10f5c86b23cf49512e0c3f32d4491d767f2c0946a50a35e9d9be014b5 WatchSource:0}: Error finding container d3b249d10f5c86b23cf49512e0c3f32d4491d767f2c0946a50a35e9d9be014b5: Status 404 returned error can't find the container with id d3b249d10f5c86b23cf49512e0c3f32d4491d767f2c0946a50a35e9d9be014b5 Jun 02 19:11:03.935210 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:03.935119 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" event={"ID":"61fc0352-3d7b-47c6-a753-dc663e95bba4","Type":"ContainerStarted","Data":"d3b249d10f5c86b23cf49512e0c3f32d4491d767f2c0946a50a35e9d9be014b5"} Jun 02 19:11:05.903349 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:05.903322 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-46fcg" Jun 02 19:11:06.948423 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:06.948387 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" event={"ID":"61fc0352-3d7b-47c6-a753-dc663e95bba4","Type":"ContainerStarted","Data":"aba230e2bfa49e141cbd5fe5b0d4ec959f107ec8c5371f12a6e36342af49e26c"} Jun 02 19:11:06.985077 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:06.985022 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-76d7946f8d-46gfw" podStartSLOduration=1.7470253580000001 podStartE2EDuration="3.985008473s" podCreationTimestamp="2026-06-02 19:11:03 +0000 UTC" firstStartedPulling="2026-06-02 19:11:03.720241987 +0000 UTC m=+433.838045702" lastFinishedPulling="2026-06-02 19:11:05.958225099 +0000 UTC m=+436.076028817" observedRunningTime="2026-06-02 19:11:06.982872586 +0000 UTC m=+437.100676321" watchObservedRunningTime="2026-06-02 19:11:06.985008473 +0000 UTC m=+437.102812207" Jun 02 19:11:17.850786 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:17.850754 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-2gc5c" Jun 02 19:11:18.859178 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:18.859151 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-dl469" Jun 02 19:11:50.494259 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.494226 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk"] Jun 02 19:11:50.497730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.497709 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.500833 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.500813 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:11:50.500965 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.500887 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:11:50.501950 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.501917 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g98bw\"" Jun 02 19:11:50.505367 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.505343 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk"] Jun 02 19:11:50.640387 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.640342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.640579 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.640426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvnsl\" (UniqueName: \"kubernetes.io/projected/496d738e-6496-4a38-8135-9a1b9a2b1834-kube-api-access-vvnsl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.640579 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.640453 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.741406 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.741370 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.741585 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.741449 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvnsl\" (UniqueName: \"kubernetes.io/projected/496d738e-6496-4a38-8135-9a1b9a2b1834-kube-api-access-vvnsl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.741585 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.741477 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.741877 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.741852 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.741948 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.741864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.750664 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.750583 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvnsl\" (UniqueName: \"kubernetes.io/projected/496d738e-6496-4a38-8135-9a1b9a2b1834-kube-api-access-vvnsl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.807720 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.807648 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:50.898841 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.898812 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l"] Jun 02 19:11:50.902272 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.902250 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:50.912091 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.912065 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l"] Jun 02 19:11:50.941358 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:50.941338 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk"] Jun 02 19:11:50.943703 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:11:50.943663 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496d738e_6496_4a38_8135_9a1b9a2b1834.slice/crio-f417d78677192b368e238d0c1dc3c62743cadab2f3866b2c94f283f2acd7fe35 WatchSource:0}: Error finding container f417d78677192b368e238d0c1dc3c62743cadab2f3866b2c94f283f2acd7fe35: Status 404 returned error can't find the container with id f417d78677192b368e238d0c1dc3c62743cadab2f3866b2c94f283f2acd7fe35 Jun 02 19:11:51.044801 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.044776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.044905 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.044810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.044905 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.044892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmxm\" (UniqueName: \"kubernetes.io/projected/d36ccbef-044f-4d71-acde-db3f72260af5-kube-api-access-kqmxm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.097237 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.097208 2582 generic.go:358] "Generic (PLEG): container finished" podID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerID="283bb7825802f4212d9613ff92daa4fc1848c3fa1708ad6ed2afbd55a73ac51d" exitCode=0 Jun 02 19:11:51.097405 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.097265 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" event={"ID":"496d738e-6496-4a38-8135-9a1b9a2b1834","Type":"ContainerDied","Data":"283bb7825802f4212d9613ff92daa4fc1848c3fa1708ad6ed2afbd55a73ac51d"} Jun 02 19:11:51.097405 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.097287 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" event={"ID":"496d738e-6496-4a38-8135-9a1b9a2b1834","Type":"ContainerStarted","Data":"f417d78677192b368e238d0c1dc3c62743cadab2f3866b2c94f283f2acd7fe35"} Jun 02 19:11:51.145874 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.145832 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmxm\" (UniqueName: \"kubernetes.io/projected/d36ccbef-044f-4d71-acde-db3f72260af5-kube-api-access-kqmxm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.146053 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.145916 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.146053 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.145935 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.146369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.146349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.146409 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.146371 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.154551 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.154522 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmxm\" (UniqueName: \"kubernetes.io/projected/d36ccbef-044f-4d71-acde-db3f72260af5-kube-api-access-kqmxm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.215266 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.215228 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:51.303456 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.303422 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv"] Jun 02 19:11:51.306564 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.306541 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.317211 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.317164 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv"] Jun 02 19:11:51.347886 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.347861 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l"] Jun 02 19:11:51.350175 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:11:51.350150 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36ccbef_044f_4d71_acde_db3f72260af5.slice/crio-ec0f0ff8f4a19fbe036e88a674ff3e2f923447360f7b1ac0f844f28e514c9233 WatchSource:0}: Error finding container ec0f0ff8f4a19fbe036e88a674ff3e2f923447360f7b1ac0f844f28e514c9233: Status 404 returned error can't find the container with id ec0f0ff8f4a19fbe036e88a674ff3e2f923447360f7b1ac0f844f28e514c9233 Jun 02 19:11:51.449073 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.449044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.449198 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.449080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.449198 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.449127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvjmh\" (UniqueName: \"kubernetes.io/projected/1c205bcb-a249-484d-afd5-36dcb89dca43-kube-api-access-fvjmh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.550548 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.550458 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.550548 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.550505 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.551061 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.550742 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvjmh\" (UniqueName: \"kubernetes.io/projected/1c205bcb-a249-484d-afd5-36dcb89dca43-kube-api-access-fvjmh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.551061 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.550925 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.551212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.551187 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.560042 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.560011 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvjmh\" (UniqueName: \"kubernetes.io/projected/1c205bcb-a249-484d-afd5-36dcb89dca43-kube-api-access-fvjmh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.619143 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.619107 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:51.699233 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.698396 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj"] Jun 02 19:11:51.701464 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.701441 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.714299 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.714218 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj"] Jun 02 19:11:51.753438 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.753405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.753438 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.753451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.753658 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.753553 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p9zw\" (UniqueName: \"kubernetes.io/projected/6f78c40d-1045-4d99-8024-0098da3a1b9c-kube-api-access-6p9zw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.762934 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.762900 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv"] Jun 02 19:11:51.765849 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:11:51.765819 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c205bcb_a249_484d_afd5_36dcb89dca43.slice/crio-eb4f057e0351be1e1e909e3736cef00baeb1fdcbdbd9f1dfffb36d191b25a995 WatchSource:0}: Error finding container eb4f057e0351be1e1e909e3736cef00baeb1fdcbdbd9f1dfffb36d191b25a995: Status 404 returned error can't find the container with id eb4f057e0351be1e1e909e3736cef00baeb1fdcbdbd9f1dfffb36d191b25a995 Jun 02 19:11:51.854998 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.854969 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.855104 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.855027 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.855177 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.855103 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6p9zw\" (UniqueName: \"kubernetes.io/projected/6f78c40d-1045-4d99-8024-0098da3a1b9c-kube-api-access-6p9zw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.855435 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.855405 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.855527 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.855478 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:51.863896 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:51.863872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p9zw\" (UniqueName: \"kubernetes.io/projected/6f78c40d-1045-4d99-8024-0098da3a1b9c-kube-api-access-6p9zw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:52.014798 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.014753 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:52.103149 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.103114 2582 generic.go:358] "Generic (PLEG): container finished" podID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerID="d9e283a85153b337e9fbdbd5cd65b912283d101f9b5300fbc56c2a8a94e34c3d" exitCode=0 Jun 02 19:11:52.103313 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.103214 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" event={"ID":"1c205bcb-a249-484d-afd5-36dcb89dca43","Type":"ContainerDied","Data":"d9e283a85153b337e9fbdbd5cd65b912283d101f9b5300fbc56c2a8a94e34c3d"} Jun 02 19:11:52.103313 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.103270 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" event={"ID":"1c205bcb-a249-484d-afd5-36dcb89dca43","Type":"ContainerStarted","Data":"eb4f057e0351be1e1e909e3736cef00baeb1fdcbdbd9f1dfffb36d191b25a995"} Jun 02 19:11:52.105096 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.105069 2582 generic.go:358] "Generic (PLEG): container finished" podID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerID="1f378a35c146ee8a4f86a7d057c99db0e1f94a1ee9805450377f4bf55a02ff4d" exitCode=0 Jun 02 19:11:52.105233 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.105136 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" event={"ID":"496d738e-6496-4a38-8135-9a1b9a2b1834","Type":"ContainerDied","Data":"1f378a35c146ee8a4f86a7d057c99db0e1f94a1ee9805450377f4bf55a02ff4d"} Jun 02 19:11:52.106684 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.106646 2582 generic.go:358] "Generic (PLEG): container finished" podID="d36ccbef-044f-4d71-acde-db3f72260af5" containerID="2173dd289023fc37e3a82f892f8056cb1165071bb75539e84d4fe25fd95af28c" exitCode=0 Jun 02 19:11:52.106684 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.106675 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" event={"ID":"d36ccbef-044f-4d71-acde-db3f72260af5","Type":"ContainerDied","Data":"2173dd289023fc37e3a82f892f8056cb1165071bb75539e84d4fe25fd95af28c"} Jun 02 19:11:52.106926 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.106724 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" event={"ID":"d36ccbef-044f-4d71-acde-db3f72260af5","Type":"ContainerStarted","Data":"ec0f0ff8f4a19fbe036e88a674ff3e2f923447360f7b1ac0f844f28e514c9233"} Jun 02 19:11:52.151562 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:52.151538 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj"] Jun 02 19:11:52.156883 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:11:52.156856 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f78c40d_1045_4d99_8024_0098da3a1b9c.slice/crio-958e5e4900c9c6770082317858993f94ae82f2d73630651e8c86114deb46ec2d WatchSource:0}: Error finding container 958e5e4900c9c6770082317858993f94ae82f2d73630651e8c86114deb46ec2d: Status 404 returned error can't find the container with id 958e5e4900c9c6770082317858993f94ae82f2d73630651e8c86114deb46ec2d Jun 02 19:11:53.111539 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.111505 2582 generic.go:358] "Generic (PLEG): container finished" podID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerID="feb77745c387c28d2ab5d913c0ab3391575608fce1ab100aa0aeb450b1ad87e8" exitCode=0 Jun 02 19:11:53.112050 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.111593 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" event={"ID":"1c205bcb-a249-484d-afd5-36dcb89dca43","Type":"ContainerDied","Data":"feb77745c387c28d2ab5d913c0ab3391575608fce1ab100aa0aeb450b1ad87e8"} Jun 02 19:11:53.113606 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.113584 2582 generic.go:358] "Generic (PLEG): container finished" podID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerID="5fa79f781fbbc61c3187c68a62b5fbb2efc226ca285dc40585e18cbfe7749b5b" exitCode=0 Jun 02 19:11:53.113711 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.113658 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" event={"ID":"496d738e-6496-4a38-8135-9a1b9a2b1834","Type":"ContainerDied","Data":"5fa79f781fbbc61c3187c68a62b5fbb2efc226ca285dc40585e18cbfe7749b5b"} Jun 02 19:11:53.115151 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.115128 2582 generic.go:358] "Generic (PLEG): container finished" podID="d36ccbef-044f-4d71-acde-db3f72260af5" containerID="3c0bf7e93181b227b3574fbe231ae1fc76482deb5076f4b62993cf2b43090151" exitCode=0 Jun 02 19:11:53.115236 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.115194 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" event={"ID":"d36ccbef-044f-4d71-acde-db3f72260af5","Type":"ContainerDied","Data":"3c0bf7e93181b227b3574fbe231ae1fc76482deb5076f4b62993cf2b43090151"} Jun 02 19:11:53.116746 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.116726 2582 generic.go:358] "Generic (PLEG): container finished" podID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerID="7d6322f614214439f7700d1bac7decf1e568741b50153cee7fe989eb1392402e" exitCode=0 Jun 02 19:11:53.116834 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.116770 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" event={"ID":"6f78c40d-1045-4d99-8024-0098da3a1b9c","Type":"ContainerDied","Data":"7d6322f614214439f7700d1bac7decf1e568741b50153cee7fe989eb1392402e"} Jun 02 19:11:53.116834 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:53.116786 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" event={"ID":"6f78c40d-1045-4d99-8024-0098da3a1b9c","Type":"ContainerStarted","Data":"958e5e4900c9c6770082317858993f94ae82f2d73630651e8c86114deb46ec2d"} Jun 02 19:11:54.122670 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.122633 2582 generic.go:358] "Generic (PLEG): container finished" podID="d36ccbef-044f-4d71-acde-db3f72260af5" containerID="e1f83e54f354b9ecfca1b96ec066c2807f8b9eabc43e8fc008cf54a6bcd62f7a" exitCode=0 Jun 02 19:11:54.123102 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.122722 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" event={"ID":"d36ccbef-044f-4d71-acde-db3f72260af5","Type":"ContainerDied","Data":"e1f83e54f354b9ecfca1b96ec066c2807f8b9eabc43e8fc008cf54a6bcd62f7a"} Jun 02 19:11:54.124369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.124345 2582 generic.go:358] "Generic (PLEG): container finished" podID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerID="6555dfecdfb74a3b37c7a9cfa0b9821416cf6a29d53078e01c7778ffb56422ec" exitCode=0 Jun 02 19:11:54.124499 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.124428 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" event={"ID":"6f78c40d-1045-4d99-8024-0098da3a1b9c","Type":"ContainerDied","Data":"6555dfecdfb74a3b37c7a9cfa0b9821416cf6a29d53078e01c7778ffb56422ec"} Jun 02 19:11:54.126513 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.126491 2582 generic.go:358] "Generic (PLEG): container finished" podID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerID="4990d7393368490c96ff3237ad1594f0ae93f5e264019aa167ec88a6e0061423" exitCode=0 Jun 02 19:11:54.126619 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.126574 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" event={"ID":"1c205bcb-a249-484d-afd5-36dcb89dca43","Type":"ContainerDied","Data":"4990d7393368490c96ff3237ad1594f0ae93f5e264019aa167ec88a6e0061423"} Jun 02 19:11:54.255730 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.255706 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:54.377236 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.377135 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvnsl\" (UniqueName: \"kubernetes.io/projected/496d738e-6496-4a38-8135-9a1b9a2b1834-kube-api-access-vvnsl\") pod \"496d738e-6496-4a38-8135-9a1b9a2b1834\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " Jun 02 19:11:54.377236 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.377195 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-bundle\") pod \"496d738e-6496-4a38-8135-9a1b9a2b1834\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " Jun 02 19:11:54.377236 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.377218 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-util\") pod \"496d738e-6496-4a38-8135-9a1b9a2b1834\" (UID: \"496d738e-6496-4a38-8135-9a1b9a2b1834\") " Jun 02 19:11:54.377821 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.377791 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-bundle" (OuterVolumeSpecName: "bundle") pod "496d738e-6496-4a38-8135-9a1b9a2b1834" (UID: "496d738e-6496-4a38-8135-9a1b9a2b1834"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:54.379478 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.379459 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496d738e-6496-4a38-8135-9a1b9a2b1834-kube-api-access-vvnsl" (OuterVolumeSpecName: "kube-api-access-vvnsl") pod "496d738e-6496-4a38-8135-9a1b9a2b1834" (UID: "496d738e-6496-4a38-8135-9a1b9a2b1834"). InnerVolumeSpecName "kube-api-access-vvnsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:11:54.382529 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.382507 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-util" (OuterVolumeSpecName: "util") pod "496d738e-6496-4a38-8135-9a1b9a2b1834" (UID: "496d738e-6496-4a38-8135-9a1b9a2b1834"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:54.478090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.478040 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:54.478090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.478086 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/496d738e-6496-4a38-8135-9a1b9a2b1834-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:54.478090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:54.478096 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvnsl\" (UniqueName: \"kubernetes.io/projected/496d738e-6496-4a38-8135-9a1b9a2b1834-kube-api-access-vvnsl\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:55.131856 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.131824 2582 generic.go:358] "Generic (PLEG): container finished" podID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerID="c30df1a9ece392686b10aeb8f4e5e08c0149aa18ce1c8ea6b9dd731c1a9954ae" exitCode=0 Jun 02 19:11:55.132228 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.131911 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" event={"ID":"6f78c40d-1045-4d99-8024-0098da3a1b9c","Type":"ContainerDied","Data":"c30df1a9ece392686b10aeb8f4e5e08c0149aa18ce1c8ea6b9dd731c1a9954ae"} Jun 02 19:11:55.133568 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.133541 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" event={"ID":"496d738e-6496-4a38-8135-9a1b9a2b1834","Type":"ContainerDied","Data":"f417d78677192b368e238d0c1dc3c62743cadab2f3866b2c94f283f2acd7fe35"} Jun 02 19:11:55.133679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.133571 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk" Jun 02 19:11:55.133679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.133573 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f417d78677192b368e238d0c1dc3c62743cadab2f3866b2c94f283f2acd7fe35" Jun 02 19:11:55.284197 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.284177 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:55.287442 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.287421 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:55.387098 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387017 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-bundle\") pod \"d36ccbef-044f-4d71-acde-db3f72260af5\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " Jun 02 19:11:55.387098 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387058 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-util\") pod \"1c205bcb-a249-484d-afd5-36dcb89dca43\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " Jun 02 19:11:55.387295 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387101 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvjmh\" (UniqueName: \"kubernetes.io/projected/1c205bcb-a249-484d-afd5-36dcb89dca43-kube-api-access-fvjmh\") pod \"1c205bcb-a249-484d-afd5-36dcb89dca43\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " Jun 02 19:11:55.387295 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387140 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-util\") pod \"d36ccbef-044f-4d71-acde-db3f72260af5\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " Jun 02 19:11:55.387295 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387164 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-bundle\") pod \"1c205bcb-a249-484d-afd5-36dcb89dca43\" (UID: \"1c205bcb-a249-484d-afd5-36dcb89dca43\") " Jun 02 19:11:55.387295 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387231 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqmxm\" (UniqueName: \"kubernetes.io/projected/d36ccbef-044f-4d71-acde-db3f72260af5-kube-api-access-kqmxm\") pod \"d36ccbef-044f-4d71-acde-db3f72260af5\" (UID: \"d36ccbef-044f-4d71-acde-db3f72260af5\") " Jun 02 19:11:55.387652 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387624 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-bundle" (OuterVolumeSpecName: "bundle") pod "d36ccbef-044f-4d71-acde-db3f72260af5" (UID: "d36ccbef-044f-4d71-acde-db3f72260af5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:55.387793 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.387672 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-bundle" (OuterVolumeSpecName: "bundle") pod "1c205bcb-a249-484d-afd5-36dcb89dca43" (UID: "1c205bcb-a249-484d-afd5-36dcb89dca43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:55.389347 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.389311 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36ccbef-044f-4d71-acde-db3f72260af5-kube-api-access-kqmxm" (OuterVolumeSpecName: "kube-api-access-kqmxm") pod "d36ccbef-044f-4d71-acde-db3f72260af5" (UID: "d36ccbef-044f-4d71-acde-db3f72260af5"). InnerVolumeSpecName "kube-api-access-kqmxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:11:55.389446 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.389413 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c205bcb-a249-484d-afd5-36dcb89dca43-kube-api-access-fvjmh" (OuterVolumeSpecName: "kube-api-access-fvjmh") pod "1c205bcb-a249-484d-afd5-36dcb89dca43" (UID: "1c205bcb-a249-484d-afd5-36dcb89dca43"). InnerVolumeSpecName "kube-api-access-fvjmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:11:55.394853 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.394827 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-util" (OuterVolumeSpecName: "util") pod "1c205bcb-a249-484d-afd5-36dcb89dca43" (UID: "1c205bcb-a249-484d-afd5-36dcb89dca43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:55.395258 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.395240 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-util" (OuterVolumeSpecName: "util") pod "d36ccbef-044f-4d71-acde-db3f72260af5" (UID: "d36ccbef-044f-4d71-acde-db3f72260af5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:55.488580 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.488530 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:55.488580 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.488573 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:55.488580 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.488585 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvjmh\" (UniqueName: \"kubernetes.io/projected/1c205bcb-a249-484d-afd5-36dcb89dca43-kube-api-access-fvjmh\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:55.488580 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.488594 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36ccbef-044f-4d71-acde-db3f72260af5-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:55.488889 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.488603 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c205bcb-a249-484d-afd5-36dcb89dca43-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:55.488889 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:55.488611 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqmxm\" (UniqueName: \"kubernetes.io/projected/d36ccbef-044f-4d71-acde-db3f72260af5-kube-api-access-kqmxm\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:56.139045 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.139003 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" event={"ID":"1c205bcb-a249-484d-afd5-36dcb89dca43","Type":"ContainerDied","Data":"eb4f057e0351be1e1e909e3736cef00baeb1fdcbdbd9f1dfffb36d191b25a995"} Jun 02 19:11:56.139045 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.139034 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv" Jun 02 19:11:56.139485 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.139044 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb4f057e0351be1e1e909e3736cef00baeb1fdcbdbd9f1dfffb36d191b25a995" Jun 02 19:11:56.140837 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.140808 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" event={"ID":"d36ccbef-044f-4d71-acde-db3f72260af5","Type":"ContainerDied","Data":"ec0f0ff8f4a19fbe036e88a674ff3e2f923447360f7b1ac0f844f28e514c9233"} Jun 02 19:11:56.140837 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.140838 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec0f0ff8f4a19fbe036e88a674ff3e2f923447360f7b1ac0f844f28e514c9233" Jun 02 19:11:56.140988 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.140852 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l" Jun 02 19:11:56.284669 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.284645 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:56.396000 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.395899 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-bundle\") pod \"6f78c40d-1045-4d99-8024-0098da3a1b9c\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " Jun 02 19:11:56.396000 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.395953 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p9zw\" (UniqueName: \"kubernetes.io/projected/6f78c40d-1045-4d99-8024-0098da3a1b9c-kube-api-access-6p9zw\") pod \"6f78c40d-1045-4d99-8024-0098da3a1b9c\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " Jun 02 19:11:56.396000 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.395987 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-util\") pod \"6f78c40d-1045-4d99-8024-0098da3a1b9c\" (UID: \"6f78c40d-1045-4d99-8024-0098da3a1b9c\") " Jun 02 19:11:56.396528 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.396501 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-bundle" (OuterVolumeSpecName: "bundle") pod "6f78c40d-1045-4d99-8024-0098da3a1b9c" (UID: "6f78c40d-1045-4d99-8024-0098da3a1b9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:56.398173 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.398147 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f78c40d-1045-4d99-8024-0098da3a1b9c-kube-api-access-6p9zw" (OuterVolumeSpecName: "kube-api-access-6p9zw") pod "6f78c40d-1045-4d99-8024-0098da3a1b9c" (UID: "6f78c40d-1045-4d99-8024-0098da3a1b9c"). InnerVolumeSpecName "kube-api-access-6p9zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:11:56.401370 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.401343 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-util" (OuterVolumeSpecName: "util") pod "6f78c40d-1045-4d99-8024-0098da3a1b9c" (UID: "6f78c40d-1045-4d99-8024-0098da3a1b9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:11:56.496797 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.496772 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:56.496797 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.496798 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p9zw\" (UniqueName: \"kubernetes.io/projected/6f78c40d-1045-4d99-8024-0098da3a1b9c-kube-api-access-6p9zw\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:56.496944 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:56.496809 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f78c40d-1045-4d99-8024-0098da3a1b9c-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:11:57.146203 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:57.146172 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" Jun 02 19:11:57.146203 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:57.146187 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj" event={"ID":"6f78c40d-1045-4d99-8024-0098da3a1b9c","Type":"ContainerDied","Data":"958e5e4900c9c6770082317858993f94ae82f2d73630651e8c86114deb46ec2d"} Jun 02 19:11:57.146640 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:11:57.146214 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="958e5e4900c9c6770082317858993f94ae82f2d73630651e8c86114deb46ec2d" Jun 02 19:12:10.126382 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126341 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv"] Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126671 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="extract" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126683 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="extract" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126709 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126715 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126722 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="pull" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126727 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="pull" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126736 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126741 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126747 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="pull" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126753 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="pull" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126758 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="extract" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126763 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="extract" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126770 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126774 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126781 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="util" Jun 02 19:12:10.126781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126787 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="util" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126793 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="pull" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126798 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="pull" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126804 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126809 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126816 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="pull" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126821 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="pull" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126831 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126835 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126879 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c205bcb-a249-484d-afd5-36dcb89dca43" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126886 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="496d738e-6496-4a38-8135-9a1b9a2b1834" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126896 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f78c40d-1045-4d99-8024-0098da3a1b9c" containerName="extract" Jun 02 19:12:10.127273 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.126902 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="d36ccbef-044f-4d71-acde-db3f72260af5" containerName="extract" Jun 02 19:12:10.129031 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.129015 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:10.132612 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.132593 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-l7rpr\"" Jun 02 19:12:10.133396 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.133373 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:12:10.133853 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.133838 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:12:10.142942 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.142919 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv"] Jun 02 19:12:10.221574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.221535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snbkq\" (UniqueName: \"kubernetes.io/projected/1327fe18-45ba-4e16-b1b1-866752869ca8-kube-api-access-snbkq\") pod \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" (UID: \"1327fe18-45ba-4e16-b1b1-866752869ca8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:10.322102 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.322067 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snbkq\" (UniqueName: \"kubernetes.io/projected/1327fe18-45ba-4e16-b1b1-866752869ca8-kube-api-access-snbkq\") pod \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" (UID: \"1327fe18-45ba-4e16-b1b1-866752869ca8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:10.333086 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.333055 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snbkq\" (UniqueName: \"kubernetes.io/projected/1327fe18-45ba-4e16-b1b1-866752869ca8-kube-api-access-snbkq\") pod \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" (UID: \"1327fe18-45ba-4e16-b1b1-866752869ca8\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:10.439009 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.438919 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:10.573672 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:10.573644 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv"] Jun 02 19:12:10.575527 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:12:10.575499 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1327fe18_45ba_4e16_b1b1_866752869ca8.slice/crio-655545e07ee33a864ac4eee183e831243ad71e8f5cbd095958661d3d0cae5f21 WatchSource:0}: Error finding container 655545e07ee33a864ac4eee183e831243ad71e8f5cbd095958661d3d0cae5f21: Status 404 returned error can't find the container with id 655545e07ee33a864ac4eee183e831243ad71e8f5cbd095958661d3d0cae5f21 Jun 02 19:12:11.193795 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:11.193757 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" event={"ID":"1327fe18-45ba-4e16-b1b1-866752869ca8","Type":"ContainerStarted","Data":"655545e07ee33a864ac4eee183e831243ad71e8f5cbd095958661d3d0cae5f21"} Jun 02 19:12:13.203199 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:13.203163 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" event={"ID":"1327fe18-45ba-4e16-b1b1-866752869ca8","Type":"ContainerStarted","Data":"798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530"} Jun 02 19:12:13.203583 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:13.203390 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:13.223055 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:13.223008 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" podStartSLOduration=1.531207024 podStartE2EDuration="3.222994939s" podCreationTimestamp="2026-06-02 19:12:10 +0000 UTC" firstStartedPulling="2026-06-02 19:12:10.577340412 +0000 UTC m=+500.695144127" lastFinishedPulling="2026-06-02 19:12:12.269128325 +0000 UTC m=+502.386932042" observedRunningTime="2026-06-02 19:12:13.222222319 +0000 UTC m=+503.340026050" watchObservedRunningTime="2026-06-02 19:12:13.222994939 +0000 UTC m=+503.340798673" Jun 02 19:12:24.209752 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:24.209716 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:27.742619 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.742586 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv"] Jun 02 19:12:27.743078 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.742893 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" containerName="manager" containerID="cri-o://798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530" gracePeriod=2 Jun 02 19:12:27.758599 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.758560 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv"] Jun 02 19:12:27.771387 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.771360 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx"] Jun 02 19:12:27.771748 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.771733 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" containerName="manager" Jun 02 19:12:27.771841 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.771750 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" containerName="manager" Jun 02 19:12:27.771890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.771856 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" containerName="manager" Jun 02 19:12:27.774826 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.774809 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:27.778079 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.778043 2582 status_manager.go:895] "Failed to get status for pod" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" err="pods \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" Jun 02 19:12:27.792380 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.792353 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx"] Jun 02 19:12:27.864901 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.864865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b48rl\" (UniqueName: \"kubernetes.io/projected/282f082f-bf6f-4ff9-8dc2-c48a67aa404f-kube-api-access-b48rl\") pod \"limitador-operator-controller-manager-85c4996f8c-lfzdx\" (UID: \"282f082f-bf6f-4ff9-8dc2-c48a67aa404f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:27.965783 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.965752 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b48rl\" (UniqueName: \"kubernetes.io/projected/282f082f-bf6f-4ff9-8dc2-c48a67aa404f-kube-api-access-b48rl\") pod \"limitador-operator-controller-manager-85c4996f8c-lfzdx\" (UID: \"282f082f-bf6f-4ff9-8dc2-c48a67aa404f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:27.975596 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.975577 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:27.978260 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.978233 2582 status_manager.go:895] "Failed to get status for pod" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" err="pods \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" Jun 02 19:12:27.987525 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:27.987498 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b48rl\" (UniqueName: \"kubernetes.io/projected/282f082f-bf6f-4ff9-8dc2-c48a67aa404f-kube-api-access-b48rl\") pod \"limitador-operator-controller-manager-85c4996f8c-lfzdx\" (UID: \"282f082f-bf6f-4ff9-8dc2-c48a67aa404f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:28.009040 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.008974 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg"] Jun 02 19:12:28.012449 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.012434 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.015218 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.015193 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2krs9\"" Jun 02 19:12:28.025184 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.025156 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg"] Jun 02 19:12:28.054847 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.054810 2582 status_manager.go:895] "Failed to get status for pod" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" err="pods \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" Jun 02 19:12:28.066107 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.066087 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snbkq\" (UniqueName: \"kubernetes.io/projected/1327fe18-45ba-4e16-b1b1-866752869ca8-kube-api-access-snbkq\") pod \"1327fe18-45ba-4e16-b1b1-866752869ca8\" (UID: \"1327fe18-45ba-4e16-b1b1-866752869ca8\") " Jun 02 19:12:28.066192 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.066173 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfpbg\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.066255 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.066205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rlm\" (UniqueName: \"kubernetes.io/projected/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-kube-api-access-c5rlm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfpbg\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.068136 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.068113 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1327fe18-45ba-4e16-b1b1-866752869ca8-kube-api-access-snbkq" (OuterVolumeSpecName: "kube-api-access-snbkq") pod "1327fe18-45ba-4e16-b1b1-866752869ca8" (UID: "1327fe18-45ba-4e16-b1b1-866752869ca8"). InnerVolumeSpecName "kube-api-access-snbkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:12:28.137392 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.137358 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:28.167527 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.167496 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rlm\" (UniqueName: \"kubernetes.io/projected/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-kube-api-access-c5rlm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfpbg\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.167677 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.167576 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfpbg\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.167677 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.167618 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snbkq\" (UniqueName: \"kubernetes.io/projected/1327fe18-45ba-4e16-b1b1-866752869ca8-kube-api-access-snbkq\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:12:28.167930 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.167914 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfpbg\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.180299 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.180268 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rlm\" (UniqueName: \"kubernetes.io/projected/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-kube-api-access-c5rlm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfpbg\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.257111 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.257076 2582 generic.go:358] "Generic (PLEG): container finished" podID="1327fe18-45ba-4e16-b1b1-866752869ca8" containerID="798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530" exitCode=0 Jun 02 19:12:28.257275 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.257135 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" Jun 02 19:12:28.257275 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.257137 2582 scope.go:117] "RemoveContainer" containerID="798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530" Jun 02 19:12:28.259675 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.259605 2582 status_manager.go:895] "Failed to get status for pod" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" err="pods \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" Jun 02 19:12:28.265821 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.265797 2582 scope.go:117] "RemoveContainer" containerID="798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530" Jun 02 19:12:28.266131 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:12:28.266093 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530\": container with ID starting with 798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530 not found: ID does not exist" containerID="798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530" Jun 02 19:12:28.266186 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.266140 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530"} err="failed to get container status \"798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530\": rpc error: code = NotFound desc = could not find container \"798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530\": container with ID starting with 798c6aedf1c990e841056d4cb59e10d37a55846c438e312b7f5d5e995b7e3530 not found: ID does not exist" Jun 02 19:12:28.267469 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.267437 2582 status_manager.go:895] "Failed to get status for pod" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n9jbv" err="pods \"limitador-operator-controller-manager-85c4996f8c-n9jbv\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" Jun 02 19:12:28.269657 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.269634 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx"] Jun 02 19:12:28.272977 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:12:28.272955 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282f082f_bf6f_4ff9_8dc2_c48a67aa404f.slice/crio-bdaf08fbea25fc7839dd30585b5c76b4ad67a8c62be7db2d6e8a3e7e60fa8fee WatchSource:0}: Error finding container bdaf08fbea25fc7839dd30585b5c76b4ad67a8c62be7db2d6e8a3e7e60fa8fee: Status 404 returned error can't find the container with id bdaf08fbea25fc7839dd30585b5c76b4ad67a8c62be7db2d6e8a3e7e60fa8fee Jun 02 19:12:28.323112 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.323086 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:28.456131 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.456103 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg"] Jun 02 19:12:28.458288 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:12:28.458257 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c8e0dc_f317_49ca_acd2_0a0a43b3722c.slice/crio-f868a76e97d0c7b2c42165b61b79dfd1c6588750df27f844a93cf014b3863edf WatchSource:0}: Error finding container f868a76e97d0c7b2c42165b61b79dfd1c6588750df27f844a93cf014b3863edf: Status 404 returned error can't find the container with id f868a76e97d0c7b2c42165b61b79dfd1c6588750df27f844a93cf014b3863edf Jun 02 19:12:28.486299 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:28.486265 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1327fe18-45ba-4e16-b1b1-866752869ca8" path="/var/lib/kubelet/pods/1327fe18-45ba-4e16-b1b1-866752869ca8/volumes" Jun 02 19:12:29.263101 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:29.263063 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" event={"ID":"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c","Type":"ContainerStarted","Data":"f868a76e97d0c7b2c42165b61b79dfd1c6588750df27f844a93cf014b3863edf"} Jun 02 19:12:29.265183 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:29.265156 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" event={"ID":"282f082f-bf6f-4ff9-8dc2-c48a67aa404f","Type":"ContainerStarted","Data":"2d554d83966e8813d06d05e6472a5c53d69e82e82727672a06a9bfbadcdfb780"} Jun 02 19:12:29.265183 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:29.265187 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" event={"ID":"282f082f-bf6f-4ff9-8dc2-c48a67aa404f","Type":"ContainerStarted","Data":"bdaf08fbea25fc7839dd30585b5c76b4ad67a8c62be7db2d6e8a3e7e60fa8fee"} Jun 02 19:12:29.265376 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:29.265360 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:29.312216 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:29.312160 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" podStartSLOduration=2.312143899 podStartE2EDuration="2.312143899s" podCreationTimestamp="2026-06-02 19:12:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:12:29.310246579 +0000 UTC m=+519.428050312" watchObservedRunningTime="2026-06-02 19:12:29.312143899 +0000 UTC m=+519.429947652" Jun 02 19:12:33.282828 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:33.282792 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" event={"ID":"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c","Type":"ContainerStarted","Data":"8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2"} Jun 02 19:12:33.283207 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:33.282963 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:12:33.310860 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:33.310809 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" podStartSLOduration=1.9721989039999999 podStartE2EDuration="6.310793759s" podCreationTimestamp="2026-06-02 19:12:27 +0000 UTC" firstStartedPulling="2026-06-02 19:12:28.460538815 +0000 UTC m=+518.578342527" lastFinishedPulling="2026-06-02 19:12:32.799133656 +0000 UTC m=+522.916937382" observedRunningTime="2026-06-02 19:12:33.307750003 +0000 UTC m=+523.425553738" watchObservedRunningTime="2026-06-02 19:12:33.310793759 +0000 UTC m=+523.428597493" Jun 02 19:12:40.272742 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:40.272665 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lfzdx" Jun 02 19:12:44.288297 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:12:44.288265 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:13:36.843333 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.843296 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh"] Jun 02 19:13:36.845995 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.845978 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:36.849004 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.848980 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 19:13:36.849207 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.849021 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hwsg\"" Jun 02 19:13:36.849207 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.849030 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 19:13:36.855562 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.855541 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh"] Jun 02 19:13:36.944288 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.944252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:36.944482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.944303 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:36.944482 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:36.944418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5mqf\" (UniqueName: \"kubernetes.io/projected/be71e7f2-df33-448b-908e-9fa16d4893de-kube-api-access-k5mqf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.045541 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.045497 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.045776 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.045562 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5mqf\" (UniqueName: \"kubernetes.io/projected/be71e7f2-df33-448b-908e-9fa16d4893de-kube-api-access-k5mqf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.045776 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.045619 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.046001 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.045978 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.046001 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.045993 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.055066 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.055045 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5mqf\" (UniqueName: \"kubernetes.io/projected/be71e7f2-df33-448b-908e-9fa16d4893de-kube-api-access-k5mqf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.155960 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.155866 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:37.284761 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.284734 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh"] Jun 02 19:13:37.286389 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:13:37.286356 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe71e7f2_df33_448b_908e_9fa16d4893de.slice/crio-87a2b172b24a1baebdd5e97c33958b36b079a318d63f71c5d111e4a8a21ae5da WatchSource:0}: Error finding container 87a2b172b24a1baebdd5e97c33958b36b079a318d63f71c5d111e4a8a21ae5da: Status 404 returned error can't find the container with id 87a2b172b24a1baebdd5e97c33958b36b079a318d63f71c5d111e4a8a21ae5da Jun 02 19:13:37.525890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.525790 2582 generic.go:358] "Generic (PLEG): container finished" podID="be71e7f2-df33-448b-908e-9fa16d4893de" containerID="a96fdc72d70376769a16deda844d4a41f04672d4c22e96b4dbe2e292dfd3572a" exitCode=0 Jun 02 19:13:37.525890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.525863 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" event={"ID":"be71e7f2-df33-448b-908e-9fa16d4893de","Type":"ContainerDied","Data":"a96fdc72d70376769a16deda844d4a41f04672d4c22e96b4dbe2e292dfd3572a"} Jun 02 19:13:37.525890 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:37.525888 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" event={"ID":"be71e7f2-df33-448b-908e-9fa16d4893de","Type":"ContainerStarted","Data":"87a2b172b24a1baebdd5e97c33958b36b079a318d63f71c5d111e4a8a21ae5da"} Jun 02 19:13:38.531549 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:38.531513 2582 generic.go:358] "Generic (PLEG): container finished" podID="be71e7f2-df33-448b-908e-9fa16d4893de" containerID="3f2ec03fcdc98bf4a8f6118f948b0cd4dd403e2e0270e667b1ccbb98b96b1571" exitCode=0 Jun 02 19:13:38.531968 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:38.531606 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" event={"ID":"be71e7f2-df33-448b-908e-9fa16d4893de","Type":"ContainerDied","Data":"3f2ec03fcdc98bf4a8f6118f948b0cd4dd403e2e0270e667b1ccbb98b96b1571"} Jun 02 19:13:39.539717 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:39.539656 2582 generic.go:358] "Generic (PLEG): container finished" podID="be71e7f2-df33-448b-908e-9fa16d4893de" containerID="57435debf84abace63e849d59d2bd47081df619ee8eac7e5781d1476129de0ad" exitCode=0 Jun 02 19:13:39.540077 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:39.539777 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" event={"ID":"be71e7f2-df33-448b-908e-9fa16d4893de","Type":"ContainerDied","Data":"57435debf84abace63e849d59d2bd47081df619ee8eac7e5781d1476129de0ad"} Jun 02 19:13:40.670728 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.670681 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:40.780982 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.780944 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5mqf\" (UniqueName: \"kubernetes.io/projected/be71e7f2-df33-448b-908e-9fa16d4893de-kube-api-access-k5mqf\") pod \"be71e7f2-df33-448b-908e-9fa16d4893de\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " Jun 02 19:13:40.781153 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.780991 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-util\") pod \"be71e7f2-df33-448b-908e-9fa16d4893de\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " Jun 02 19:13:40.781153 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.781014 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-bundle\") pod \"be71e7f2-df33-448b-908e-9fa16d4893de\" (UID: \"be71e7f2-df33-448b-908e-9fa16d4893de\") " Jun 02 19:13:40.781566 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.781539 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-bundle" (OuterVolumeSpecName: "bundle") pod "be71e7f2-df33-448b-908e-9fa16d4893de" (UID: "be71e7f2-df33-448b-908e-9fa16d4893de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:13:40.783344 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.783317 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be71e7f2-df33-448b-908e-9fa16d4893de-kube-api-access-k5mqf" (OuterVolumeSpecName: "kube-api-access-k5mqf") pod "be71e7f2-df33-448b-908e-9fa16d4893de" (UID: "be71e7f2-df33-448b-908e-9fa16d4893de"). InnerVolumeSpecName "kube-api-access-k5mqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:13:40.787043 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.787010 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-util" (OuterVolumeSpecName: "util") pod "be71e7f2-df33-448b-908e-9fa16d4893de" (UID: "be71e7f2-df33-448b-908e-9fa16d4893de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:13:40.882330 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.882283 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5mqf\" (UniqueName: \"kubernetes.io/projected/be71e7f2-df33-448b-908e-9fa16d4893de-kube-api-access-k5mqf\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:13:40.882330 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.882322 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:13:40.882330 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:40.882332 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be71e7f2-df33-448b-908e-9fa16d4893de-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:13:41.547962 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:41.547933 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" Jun 02 19:13:41.548137 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:41.547932 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70p58xh" event={"ID":"be71e7f2-df33-448b-908e-9fa16d4893de","Type":"ContainerDied","Data":"87a2b172b24a1baebdd5e97c33958b36b079a318d63f71c5d111e4a8a21ae5da"} Jun 02 19:13:41.548137 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:41.548047 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87a2b172b24a1baebdd5e97c33958b36b079a318d63f71c5d111e4a8a21ae5da" Jun 02 19:13:50.433794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:50.433760 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:13:50.434439 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:13:50.434418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:14:00.152318 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152285 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:14:00.152679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152609 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="util" Jun 02 19:14:00.152679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152619 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="util" Jun 02 19:14:00.152679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152632 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="pull" Jun 02 19:14:00.152679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152637 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="pull" Jun 02 19:14:00.152679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152645 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="extract" Jun 02 19:14:00.152679 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152651 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="extract" Jun 02 19:14:00.152886 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.152716 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="be71e7f2-df33-448b-908e-9fa16d4893de" containerName="extract" Jun 02 19:14:00.160209 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.160178 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:00.163255 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.163226 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 19:14:00.163423 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.163396 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 19:14:00.163623 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.163439 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 19:14:00.163738 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.163489 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9rngb\"" Jun 02 19:14:00.163810 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.163786 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:14:00.349083 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.349042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5vm9\" (UniqueName: \"kubernetes.io/projected/bddbcdc6-743c-4849-8345-5a77cfa5e949-kube-api-access-b5vm9\") pod \"maas-keycloak-0\" (UID: \"bddbcdc6-743c-4849-8345-5a77cfa5e949\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:00.450525 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.450441 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5vm9\" (UniqueName: \"kubernetes.io/projected/bddbcdc6-743c-4849-8345-5a77cfa5e949-kube-api-access-b5vm9\") pod \"maas-keycloak-0\" (UID: \"bddbcdc6-743c-4849-8345-5a77cfa5e949\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:00.458616 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.458592 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5vm9\" (UniqueName: \"kubernetes.io/projected/bddbcdc6-743c-4849-8345-5a77cfa5e949-kube-api-access-b5vm9\") pod \"maas-keycloak-0\" (UID: \"bddbcdc6-743c-4849-8345-5a77cfa5e949\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:00.470551 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.470516 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:00.605355 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.605325 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:14:00.606910 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:14:00.606878 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbddbcdc6_743c_4849_8345_5a77cfa5e949.slice/crio-1cd65e67e3f0c7a32c0875c4cb1c7212dca8597b8fe8345b1289f753de503c95 WatchSource:0}: Error finding container 1cd65e67e3f0c7a32c0875c4cb1c7212dca8597b8fe8345b1289f753de503c95: Status 404 returned error can't find the container with id 1cd65e67e3f0c7a32c0875c4cb1c7212dca8597b8fe8345b1289f753de503c95 Jun 02 19:14:00.619889 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:00.619865 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bddbcdc6-743c-4849-8345-5a77cfa5e949","Type":"ContainerStarted","Data":"1cd65e67e3f0c7a32c0875c4cb1c7212dca8597b8fe8345b1289f753de503c95"} Jun 02 19:14:06.654781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:06.654734 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bddbcdc6-743c-4849-8345-5a77cfa5e949","Type":"ContainerStarted","Data":"6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a"} Jun 02 19:14:06.673194 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:06.673132 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.750430952 podStartE2EDuration="6.673116978s" podCreationTimestamp="2026-06-02 19:14:00 +0000 UTC" firstStartedPulling="2026-06-02 19:14:00.608336019 +0000 UTC m=+610.726139745" lastFinishedPulling="2026-06-02 19:14:06.531022059 +0000 UTC m=+616.648825771" observedRunningTime="2026-06-02 19:14:06.671239955 +0000 UTC m=+616.789043715" watchObservedRunningTime="2026-06-02 19:14:06.673116978 +0000 UTC m=+616.790920711" Jun 02 19:14:07.470963 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:07.470862 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:07.472217 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:07.472180 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:08.471300 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:08.471247 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:09.471791 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:09.471731 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:10.471014 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:10.470976 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:10.471285 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:10.471245 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:11.471478 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:11.471427 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:12.471918 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:12.471862 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:13.471381 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:13.471325 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:14.471191 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:14.471131 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:15.471126 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:15.471080 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:16.471266 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:16.471222 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:17.471143 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:17.471087 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:18.471403 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:18.471356 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:19.471191 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:19.471143 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 02 19:14:20.581377 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:20.581344 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 19:14:20.596652 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:20.596604 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 19:14:30.587928 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:14:30.587895 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:11.121524 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.121488 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-75c6b6c5cb-fzh2j"] Jun 02 19:15:11.124303 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.124284 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.126882 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.126865 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 19:15:11.132654 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.132633 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-75c6b6c5cb-fzh2j"] Jun 02 19:15:11.180681 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.180639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzrh\" (UniqueName: \"kubernetes.io/projected/2250b23b-c3cc-4f89-99af-debd1188b7f6-kube-api-access-8pzrh\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.180865 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.180775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2250b23b-c3cc-4f89-99af-debd1188b7f6-maas-api-tls\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.281365 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.281311 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzrh\" (UniqueName: \"kubernetes.io/projected/2250b23b-c3cc-4f89-99af-debd1188b7f6-kube-api-access-8pzrh\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.281555 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.281410 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2250b23b-c3cc-4f89-99af-debd1188b7f6-maas-api-tls\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.281602 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:15:11.281552 2582 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 02 19:15:11.281640 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:15:11.281627 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2250b23b-c3cc-4f89-99af-debd1188b7f6-maas-api-tls podName:2250b23b-c3cc-4f89-99af-debd1188b7f6 nodeName:}" failed. No retries permitted until 2026-06-02 19:15:11.781610471 +0000 UTC m=+681.899414184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2250b23b-c3cc-4f89-99af-debd1188b7f6-maas-api-tls") pod "maas-api-75c6b6c5cb-fzh2j" (UID: "2250b23b-c3cc-4f89-99af-debd1188b7f6") : secret "maas-api-serving-cert" not found Jun 02 19:15:11.291005 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.290975 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzrh\" (UniqueName: \"kubernetes.io/projected/2250b23b-c3cc-4f89-99af-debd1188b7f6-kube-api-access-8pzrh\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.785965 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.785921 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2250b23b-c3cc-4f89-99af-debd1188b7f6-maas-api-tls\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:11.788427 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:11.788394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2250b23b-c3cc-4f89-99af-debd1188b7f6-maas-api-tls\") pod \"maas-api-75c6b6c5cb-fzh2j\" (UID: \"2250b23b-c3cc-4f89-99af-debd1188b7f6\") " pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:12.035468 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:12.035429 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:12.169240 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:12.169206 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-75c6b6c5cb-fzh2j"] Jun 02 19:15:12.170587 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:15:12.170557 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2250b23b_c3cc_4f89_99af_debd1188b7f6.slice/crio-1a39584677b37a13588131ee9c93986410f2518cbac5ac55376f9dbd9b1fd1a1 WatchSource:0}: Error finding container 1a39584677b37a13588131ee9c93986410f2518cbac5ac55376f9dbd9b1fd1a1: Status 404 returned error can't find the container with id 1a39584677b37a13588131ee9c93986410f2518cbac5ac55376f9dbd9b1fd1a1 Jun 02 19:15:12.172163 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:12.172147 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:15:12.936198 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:12.936149 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" event={"ID":"2250b23b-c3cc-4f89-99af-debd1188b7f6","Type":"ContainerStarted","Data":"1a39584677b37a13588131ee9c93986410f2518cbac5ac55376f9dbd9b1fd1a1"} Jun 02 19:15:14.946832 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:14.946798 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" event={"ID":"2250b23b-c3cc-4f89-99af-debd1188b7f6","Type":"ContainerStarted","Data":"8a369d656867be1794e3be2e8b45b495666489175d6a5d415e39e366276e3a44"} Jun 02 19:15:14.947220 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:14.947026 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:14.965595 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:14.965540 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" podStartSLOduration=1.571836665 podStartE2EDuration="3.965525854s" podCreationTimestamp="2026-06-02 19:15:11 +0000 UTC" firstStartedPulling="2026-06-02 19:15:12.17229641 +0000 UTC m=+682.290100122" lastFinishedPulling="2026-06-02 19:15:14.565985591 +0000 UTC m=+684.683789311" observedRunningTime="2026-06-02 19:15:14.964567993 +0000 UTC m=+685.082371728" watchObservedRunningTime="2026-06-02 19:15:14.965525854 +0000 UTC m=+685.083329597" Jun 02 19:15:20.956357 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:20.956329 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-75c6b6c5cb-fzh2j" Jun 02 19:15:22.747451 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:22.747413 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:15:22.747870 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:22.747638 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" containerID="cri-o://6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a" gracePeriod=30 Jun 02 19:15:24.397617 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.397590 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:24.501295 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.501214 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5vm9\" (UniqueName: \"kubernetes.io/projected/bddbcdc6-743c-4849-8345-5a77cfa5e949-kube-api-access-b5vm9\") pod \"bddbcdc6-743c-4849-8345-5a77cfa5e949\" (UID: \"bddbcdc6-743c-4849-8345-5a77cfa5e949\") " Jun 02 19:15:24.503370 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.503347 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bddbcdc6-743c-4849-8345-5a77cfa5e949-kube-api-access-b5vm9" (OuterVolumeSpecName: "kube-api-access-b5vm9") pod "bddbcdc6-743c-4849-8345-5a77cfa5e949" (UID: "bddbcdc6-743c-4849-8345-5a77cfa5e949"). InnerVolumeSpecName "kube-api-access-b5vm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:15:24.602751 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.602716 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5vm9\" (UniqueName: \"kubernetes.io/projected/bddbcdc6-743c-4849-8345-5a77cfa5e949-kube-api-access-b5vm9\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:15:24.990541 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.990504 2582 generic.go:358] "Generic (PLEG): container finished" podID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerID="6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a" exitCode=143 Jun 02 19:15:24.990736 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.990572 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:24.990736 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.990587 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bddbcdc6-743c-4849-8345-5a77cfa5e949","Type":"ContainerDied","Data":"6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a"} Jun 02 19:15:24.990736 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.990623 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bddbcdc6-743c-4849-8345-5a77cfa5e949","Type":"ContainerDied","Data":"1cd65e67e3f0c7a32c0875c4cb1c7212dca8597b8fe8345b1289f753de503c95"} Jun 02 19:15:24.990736 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:24.990638 2582 scope.go:117] "RemoveContainer" containerID="6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a" Jun 02 19:15:25.000225 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.000207 2582 scope.go:117] "RemoveContainer" containerID="6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a" Jun 02 19:15:25.000472 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:15:25.000450 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a\": container with ID starting with 6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a not found: ID does not exist" containerID="6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a" Jun 02 19:15:25.000535 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.000479 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a"} err="failed to get container status \"6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a\": rpc error: code = NotFound desc = could not find container \"6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a\": container with ID starting with 6495d2c994fc7eff78fc1b1118784e8092b7d81408f16a146cd017afe2ba6e5a not found: ID does not exist" Jun 02 19:15:25.012839 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.012816 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:15:25.016294 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.016275 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:15:25.037762 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.037739 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:15:25.038065 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.038054 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" Jun 02 19:15:25.038106 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.038067 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" Jun 02 19:15:25.038140 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.038130 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" containerName="keycloak" Jun 02 19:15:25.040656 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.040642 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.043492 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.043473 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 19:15:25.043600 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.043537 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 19:15:25.043600 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.043550 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 19:15:25.043600 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.043537 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 19:15:25.043793 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.043615 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9rngb\"" Jun 02 19:15:25.050265 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.050246 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:15:25.208061 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.208018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcq79\" (UniqueName: \"kubernetes.io/projected/b54d002f-8869-424f-b071-fa2ad571d300-kube-api-access-gcq79\") pod \"maas-keycloak-0\" (UID: \"b54d002f-8869-424f-b071-fa2ad571d300\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.208232 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.208100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b54d002f-8869-424f-b071-fa2ad571d300-test-realms\") pod \"maas-keycloak-0\" (UID: \"b54d002f-8869-424f-b071-fa2ad571d300\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.308923 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.308817 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b54d002f-8869-424f-b071-fa2ad571d300-test-realms\") pod \"maas-keycloak-0\" (UID: \"b54d002f-8869-424f-b071-fa2ad571d300\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.308923 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.308893 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcq79\" (UniqueName: \"kubernetes.io/projected/b54d002f-8869-424f-b071-fa2ad571d300-kube-api-access-gcq79\") pod \"maas-keycloak-0\" (UID: \"b54d002f-8869-424f-b071-fa2ad571d300\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.309533 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.309511 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b54d002f-8869-424f-b071-fa2ad571d300-test-realms\") pod \"maas-keycloak-0\" (UID: \"b54d002f-8869-424f-b071-fa2ad571d300\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.318152 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.318131 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcq79\" (UniqueName: \"kubernetes.io/projected/b54d002f-8869-424f-b071-fa2ad571d300-kube-api-access-gcq79\") pod \"maas-keycloak-0\" (UID: \"b54d002f-8869-424f-b071-fa2ad571d300\") " pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.350996 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.350955 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:25.480837 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.480807 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 19:15:25.482945 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:15:25.482914 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54d002f_8869_424f_b071_fa2ad571d300.slice/crio-c164bd3a31bee9c3a73767162052d3880b7444343ac010c3b4f80cd6ec30f3e6 WatchSource:0}: Error finding container c164bd3a31bee9c3a73767162052d3880b7444343ac010c3b4f80cd6ec30f3e6: Status 404 returned error can't find the container with id c164bd3a31bee9c3a73767162052d3880b7444343ac010c3b4f80cd6ec30f3e6 Jun 02 19:15:25.995337 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.995305 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b54d002f-8869-424f-b071-fa2ad571d300","Type":"ContainerStarted","Data":"b5089a59c6358091d56b81f52ad4becb89a4120b6c908a137240ed8bbe954952"} Jun 02 19:15:25.995480 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:25.995346 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b54d002f-8869-424f-b071-fa2ad571d300","Type":"ContainerStarted","Data":"c164bd3a31bee9c3a73767162052d3880b7444343ac010c3b4f80cd6ec30f3e6"} Jun 02 19:15:26.015944 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:26.015884 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.587931998 podStartE2EDuration="1.015865529s" podCreationTimestamp="2026-06-02 19:15:25 +0000 UTC" firstStartedPulling="2026-06-02 19:15:25.484240787 +0000 UTC m=+695.602044512" lastFinishedPulling="2026-06-02 19:15:25.912174328 +0000 UTC m=+696.029978043" observedRunningTime="2026-06-02 19:15:26.014196206 +0000 UTC m=+696.131999939" watchObservedRunningTime="2026-06-02 19:15:26.015865529 +0000 UTC m=+696.133669264" Jun 02 19:15:26.351755 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:26.351674 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:26.353702 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:26.353653 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:26.487740 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:26.487673 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bddbcdc6-743c-4849-8345-5a77cfa5e949" path="/var/lib/kubelet/pods/bddbcdc6-743c-4849-8345-5a77cfa5e949/volumes" Jun 02 19:15:27.351702 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:27.351636 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:28.351513 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:28.351457 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:29.352185 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:29.352132 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:30.351869 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:30.351818 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:31.352313 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:31.352274 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:32.351558 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:32.351507 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:33.351707 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:33.351646 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:34.351965 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:34.351915 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:35.351682 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:35.351616 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:35.352084 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:35.352047 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:36.352342 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:36.352289 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:37.352467 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:37.352372 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:38.352405 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:38.352362 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 02 19:15:39.483404 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:39.483373 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 19:15:39.507710 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:39.507650 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b54d002f-8869-424f-b071-fa2ad571d300" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 19:15:49.490076 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:15:49.490031 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 19:16:43.243010 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.242966 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp"] Jun 02 19:16:43.245886 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.245862 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.248784 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.248753 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 19:16:43.250066 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.250036 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 19:16:43.250202 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.250124 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6rl8w\"" Jun 02 19:16:43.250267 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.250250 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 19:16:43.258876 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.258848 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp"] Jun 02 19:16:43.291143 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.291101 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.291143 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.291142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.291396 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.291171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d37469-cec7-4ac2-827d-602dadb0cb73-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.291396 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.291242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhz5\" (UniqueName: \"kubernetes.io/projected/51d37469-cec7-4ac2-827d-602dadb0cb73-kube-api-access-5bhz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.291396 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.291281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.291396 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.291297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.391876 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.391832 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhz5\" (UniqueName: \"kubernetes.io/projected/51d37469-cec7-4ac2-827d-602dadb0cb73-kube-api-access-5bhz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392075 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.391892 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392075 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.391909 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392075 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.391940 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392075 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.391961 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392075 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.391985 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d37469-cec7-4ac2-827d-602dadb0cb73-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392412 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.392388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392471 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.392414 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.392471 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.392438 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.394336 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.394313 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d37469-cec7-4ac2-827d-602dadb0cb73-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.394486 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.394469 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d37469-cec7-4ac2-827d-602dadb0cb73-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.400114 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.400091 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhz5\" (UniqueName: \"kubernetes.io/projected/51d37469-cec7-4ac2-827d-602dadb0cb73-kube-api-access-5bhz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp\" (UID: \"51d37469-cec7-4ac2-827d-602dadb0cb73\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.558028 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.557931 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:43.693064 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:43.693038 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp"] Jun 02 19:16:43.696126 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:16:43.695453 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d37469_cec7_4ac2_827d_602dadb0cb73.slice/crio-6b30e6f6a0c89b793877738cac5bdbb183c83d45975e59a896affbc90c373047 WatchSource:0}: Error finding container 6b30e6f6a0c89b793877738cac5bdbb183c83d45975e59a896affbc90c373047: Status 404 returned error can't find the container with id 6b30e6f6a0c89b793877738cac5bdbb183c83d45975e59a896affbc90c373047 Jun 02 19:16:44.318796 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:44.318760 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" event={"ID":"51d37469-cec7-4ac2-827d-602dadb0cb73","Type":"ContainerStarted","Data":"6b30e6f6a0c89b793877738cac5bdbb183c83d45975e59a896affbc90c373047"} Jun 02 19:16:47.331949 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:47.331911 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" event={"ID":"51d37469-cec7-4ac2-827d-602dadb0cb73","Type":"ContainerStarted","Data":"d21cc5f362052765a761872c7123f23b43d5e08c51d8959313dcb2ce350dd542"} Jun 02 19:16:48.337405 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:48.337370 2582 generic.go:358] "Generic (PLEG): container finished" podID="51d37469-cec7-4ac2-827d-602dadb0cb73" containerID="d21cc5f362052765a761872c7123f23b43d5e08c51d8959313dcb2ce350dd542" exitCode=0 Jun 02 19:16:48.337817 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:48.337448 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" event={"ID":"51d37469-cec7-4ac2-827d-602dadb0cb73","Type":"ContainerDied","Data":"d21cc5f362052765a761872c7123f23b43d5e08c51d8959313dcb2ce350dd542"} Jun 02 19:16:50.347632 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:50.347596 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" event={"ID":"51d37469-cec7-4ac2-827d-602dadb0cb73","Type":"ContainerStarted","Data":"cac1aa1a73e37311e0af240741dc767ec4fd6734a2ae908a728218b5c6279ac8"} Jun 02 19:16:50.368494 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:50.368432 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" podStartSLOduration=1.54613853 podStartE2EDuration="7.368418871s" podCreationTimestamp="2026-06-02 19:16:43 +0000 UTC" firstStartedPulling="2026-06-02 19:16:43.699031819 +0000 UTC m=+773.816835531" lastFinishedPulling="2026-06-02 19:16:49.521312161 +0000 UTC m=+779.639115872" observedRunningTime="2026-06-02 19:16:50.365670696 +0000 UTC m=+780.483474429" watchObservedRunningTime="2026-06-02 19:16:50.368418871 +0000 UTC m=+780.486222604" Jun 02 19:16:52.442603 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.442547 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq"] Jun 02 19:16:52.445524 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.445503 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.448571 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.448550 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 19:16:52.457314 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.457277 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq"] Jun 02 19:16:52.472605 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.472572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea7ea4f-694f-43f8-9e06-67a380e1a706-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.472764 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.472620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.472764 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.472723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.472764 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.472749 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.472892 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.472773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.472892 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.472790 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpllp\" (UniqueName: \"kubernetes.io/projected/bea7ea4f-694f-43f8-9e06-67a380e1a706-kube-api-access-gpllp\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573185 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573142 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573242 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573351 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573276 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573446 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573419 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573496 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573467 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpllp\" (UniqueName: \"kubernetes.io/projected/bea7ea4f-694f-43f8-9e06-67a380e1a706-kube-api-access-gpllp\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573557 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573498 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea7ea4f-694f-43f8-9e06-67a380e1a706-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573784 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573759 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573922 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573792 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.573922 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.573759 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.575570 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.575546 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bea7ea4f-694f-43f8-9e06-67a380e1a706-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.575953 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.575929 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bea7ea4f-694f-43f8-9e06-67a380e1a706-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.582829 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.582802 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpllp\" (UniqueName: \"kubernetes.io/projected/bea7ea4f-694f-43f8-9e06-67a380e1a706-kube-api-access-gpllp\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq\" (UID: \"bea7ea4f-694f-43f8-9e06-67a380e1a706\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.759322 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.759235 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:16:52.893291 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:52.893262 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq"] Jun 02 19:16:52.895209 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:16:52.895178 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea7ea4f_694f_43f8_9e06_67a380e1a706.slice/crio-db5f778ee1cf48a377854bf217a5adf85ba9b3a3d16e35ae3ff17c4aeff267ef WatchSource:0}: Error finding container db5f778ee1cf48a377854bf217a5adf85ba9b3a3d16e35ae3ff17c4aeff267ef: Status 404 returned error can't find the container with id db5f778ee1cf48a377854bf217a5adf85ba9b3a3d16e35ae3ff17c4aeff267ef Jun 02 19:16:53.361069 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:53.361034 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" event={"ID":"bea7ea4f-694f-43f8-9e06-67a380e1a706","Type":"ContainerStarted","Data":"b0aa41d1fad4b4196a684f560d314635e77e36ed535a601295d5961248e56ea4"} Jun 02 19:16:53.361244 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:53.361072 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" event={"ID":"bea7ea4f-694f-43f8-9e06-67a380e1a706","Type":"ContainerStarted","Data":"db5f778ee1cf48a377854bf217a5adf85ba9b3a3d16e35ae3ff17c4aeff267ef"} Jun 02 19:16:53.558459 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:53.558422 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:53.558851 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:53.558583 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:53.570801 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:53.570776 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:54.380852 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:54.380823 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp" Jun 02 19:16:57.128507 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.128475 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4"] Jun 02 19:16:57.131677 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.131655 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.134928 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.134862 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 19:16:57.142938 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.142912 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4"] Jun 02 19:16:57.217107 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.217069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.217107 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.217112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.217312 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.217200 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.217312 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.217230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da809539-bbc7-439a-a1cf-12fb01f63910-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.217312 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.217260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.217312 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.217309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cs4p\" (UniqueName: \"kubernetes.io/projected/da809539-bbc7-439a-a1cf-12fb01f63910-kube-api-access-2cs4p\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318402 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318359 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318402 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318400 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da809539-bbc7-439a-a1cf-12fb01f63910-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318625 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318425 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318625 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318450 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cs4p\" (UniqueName: \"kubernetes.io/projected/da809539-bbc7-439a-a1cf-12fb01f63910-kube-api-access-2cs4p\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318625 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318511 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318625 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318536 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318871 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318849 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.318937 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318913 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.319016 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.318994 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.320775 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.320757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da809539-bbc7-439a-a1cf-12fb01f63910-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.321049 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.321029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da809539-bbc7-439a-a1cf-12fb01f63910-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.327866 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.327843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cs4p\" (UniqueName: \"kubernetes.io/projected/da809539-bbc7-439a-a1cf-12fb01f63910-kube-api-access-2cs4p\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4\" (UID: \"da809539-bbc7-439a-a1cf-12fb01f63910\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.442921 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.442831 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:16:57.580216 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:57.580185 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4"] Jun 02 19:16:57.581488 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:16:57.581450 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda809539_bbc7_439a_a1cf_12fb01f63910.slice/crio-4467c31d7773f87cc687f7d9c66d1fd2a290b4bf41c56591534ed5bf0fa61879 WatchSource:0}: Error finding container 4467c31d7773f87cc687f7d9c66d1fd2a290b4bf41c56591534ed5bf0fa61879: Status 404 returned error can't find the container with id 4467c31d7773f87cc687f7d9c66d1fd2a290b4bf41c56591534ed5bf0fa61879 Jun 02 19:16:58.381494 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:58.381451 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" event={"ID":"da809539-bbc7-439a-a1cf-12fb01f63910","Type":"ContainerStarted","Data":"d156cd44136454c41b4a5726940c1426f108b882a834b4f3268084aac17e93a4"} Jun 02 19:16:58.381494 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:16:58.381498 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" event={"ID":"da809539-bbc7-439a-a1cf-12fb01f63910","Type":"ContainerStarted","Data":"4467c31d7773f87cc687f7d9c66d1fd2a290b4bf41c56591534ed5bf0fa61879"} Jun 02 19:17:02.397590 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:02.397550 2582 generic.go:358] "Generic (PLEG): container finished" podID="da809539-bbc7-439a-a1cf-12fb01f63910" containerID="d156cd44136454c41b4a5726940c1426f108b882a834b4f3268084aac17e93a4" exitCode=0 Jun 02 19:17:02.398031 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:02.397623 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" event={"ID":"da809539-bbc7-439a-a1cf-12fb01f63910","Type":"ContainerDied","Data":"d156cd44136454c41b4a5726940c1426f108b882a834b4f3268084aac17e93a4"} Jun 02 19:17:03.402896 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:03.402858 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" event={"ID":"da809539-bbc7-439a-a1cf-12fb01f63910","Type":"ContainerStarted","Data":"4c0cfa86f455d480eea272a8c33b55ee78aa11015b9c22c53786baf9fdfcc4a9"} Jun 02 19:17:03.422607 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:03.422535 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" podStartSLOduration=6.074438488 podStartE2EDuration="6.422519824s" podCreationTimestamp="2026-06-02 19:16:57 +0000 UTC" firstStartedPulling="2026-06-02 19:17:02.398250919 +0000 UTC m=+792.516054631" lastFinishedPulling="2026-06-02 19:17:02.746332255 +0000 UTC m=+792.864135967" observedRunningTime="2026-06-02 19:17:03.420999516 +0000 UTC m=+793.538803251" watchObservedRunningTime="2026-06-02 19:17:03.422519824 +0000 UTC m=+793.540323558" Jun 02 19:17:07.443521 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:07.443428 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:17:07.443521 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:07.443476 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:17:07.456245 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:07.456222 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:17:08.431814 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:08.431786 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4" Jun 02 19:17:44.561510 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:44.561472 2582 generic.go:358] "Generic (PLEG): container finished" podID="bea7ea4f-694f-43f8-9e06-67a380e1a706" containerID="b0aa41d1fad4b4196a684f560d314635e77e36ed535a601295d5961248e56ea4" exitCode=0 Jun 02 19:17:44.561950 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:44.561542 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" event={"ID":"bea7ea4f-694f-43f8-9e06-67a380e1a706","Type":"ContainerDied","Data":"b0aa41d1fad4b4196a684f560d314635e77e36ed535a601295d5961248e56ea4"} Jun 02 19:17:45.566777 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:45.566744 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" event={"ID":"bea7ea4f-694f-43f8-9e06-67a380e1a706","Type":"ContainerStarted","Data":"5be7ec1b17ef275f18b8aa636e1d7ec8a0a6884bf9ff0f5cfd732dd087d53b5c"} Jun 02 19:17:45.589176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:45.589128 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" podStartSLOduration=53.225858548 podStartE2EDuration="53.589113169s" podCreationTimestamp="2026-06-02 19:16:52 +0000 UTC" firstStartedPulling="2026-06-02 19:17:44.562200798 +0000 UTC m=+834.680004510" lastFinishedPulling="2026-06-02 19:17:44.925455415 +0000 UTC m=+835.043259131" observedRunningTime="2026-06-02 19:17:45.586807408 +0000 UTC m=+835.704611140" watchObservedRunningTime="2026-06-02 19:17:45.589113169 +0000 UTC m=+835.706916903" Jun 02 19:17:52.759428 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:52.759386 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:17:52.759428 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:52.759434 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:17:52.772307 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:52.772285 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:17:53.614893 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:17:53.614865 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq" Jun 02 19:18:50.466398 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:18:50.466320 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:18:50.467511 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:18:50.467487 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:23:50.499666 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:23:50.499634 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:23:50.503082 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:23:50.503060 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:28:50.537937 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:28:50.537895 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:28:50.541883 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:28:50.541863 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:29:59.131882 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.131843 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg"] Jun 02 19:29:59.132402 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.132077 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" podUID="d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" containerName="manager" containerID="cri-o://8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2" gracePeriod=10 Jun 02 19:29:59.387654 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.387588 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:29:59.418212 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.418180 2582 generic.go:358] "Generic (PLEG): container finished" podID="d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" containerID="8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2" exitCode=0 Jun 02 19:29:59.418369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.418229 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" event={"ID":"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c","Type":"ContainerDied","Data":"8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2"} Jun 02 19:29:59.418369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.418238 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" Jun 02 19:29:59.418369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.418255 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg" event={"ID":"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c","Type":"ContainerDied","Data":"f868a76e97d0c7b2c42165b61b79dfd1c6588750df27f844a93cf014b3863edf"} Jun 02 19:29:59.418369 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.418270 2582 scope.go:117] "RemoveContainer" containerID="8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2" Jun 02 19:29:59.426944 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.426925 2582 scope.go:117] "RemoveContainer" containerID="8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2" Jun 02 19:29:59.427228 ip-10-0-134-39 kubenswrapper[2582]: E0602 19:29:59.427205 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2\": container with ID starting with 8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2 not found: ID does not exist" containerID="8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2" Jun 02 19:29:59.427276 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.427238 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2"} err="failed to get container status \"8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2\": rpc error: code = NotFound desc = could not find container \"8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2\": container with ID starting with 8312fc63e8d57cce231091bdd0725c5c50119ca45f430e3170519e065b2c0bc2 not found: ID does not exist" Jun 02 19:29:59.512310 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.512283 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-extensions-socket-volume\") pod \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " Jun 02 19:29:59.512489 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.512340 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5rlm\" (UniqueName: \"kubernetes.io/projected/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-kube-api-access-c5rlm\") pod \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\" (UID: \"d6c8e0dc-f317-49ca-acd2-0a0a43b3722c\") " Jun 02 19:29:59.512845 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.512821 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" (UID: "d6c8e0dc-f317-49ca-acd2-0a0a43b3722c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:29:59.514346 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.514327 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-kube-api-access-c5rlm" (OuterVolumeSpecName: "kube-api-access-c5rlm") pod "d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" (UID: "d6c8e0dc-f317-49ca-acd2-0a0a43b3722c"). InnerVolumeSpecName "kube-api-access-c5rlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:29:59.613645 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.613608 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5rlm\" (UniqueName: \"kubernetes.io/projected/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-kube-api-access-c5rlm\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:29:59.613645 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.613643 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c-extensions-socket-volume\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jun 02 19:29:59.751225 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.751190 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg"] Jun 02 19:29:59.757145 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:29:59.757110 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfpbg"] Jun 02 19:30:00.487640 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:30:00.487604 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" path="/var/lib/kubelet/pods/d6c8e0dc-f317-49ca-acd2-0a0a43b3722c/volumes" Jun 02 19:31:05.243176 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.243133 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m"] Jun 02 19:31:05.243781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.243554 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" containerName="manager" Jun 02 19:31:05.243781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.243566 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" containerName="manager" Jun 02 19:31:05.243781 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.243634 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6c8e0dc-f317-49ca-acd2-0a0a43b3722c" containerName="manager" Jun 02 19:31:05.245776 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.245755 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.254101 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.254078 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2krs9\"" Jun 02 19:31:05.263954 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.263927 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m"] Jun 02 19:31:05.300875 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.300835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0333ce0-339d-419c-a3b8-4604ab587367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nxk5m\" (UID: \"b0333ce0-339d-419c-a3b8-4604ab587367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.301043 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.300983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqv5\" (UniqueName: \"kubernetes.io/projected/b0333ce0-339d-419c-a3b8-4604ab587367-kube-api-access-hzqv5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nxk5m\" (UID: \"b0333ce0-339d-419c-a3b8-4604ab587367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.401789 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.401746 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqv5\" (UniqueName: \"kubernetes.io/projected/b0333ce0-339d-419c-a3b8-4604ab587367-kube-api-access-hzqv5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nxk5m\" (UID: \"b0333ce0-339d-419c-a3b8-4604ab587367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.401961 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.401800 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0333ce0-339d-419c-a3b8-4604ab587367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nxk5m\" (UID: \"b0333ce0-339d-419c-a3b8-4604ab587367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.402138 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.402122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0333ce0-339d-419c-a3b8-4604ab587367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nxk5m\" (UID: \"b0333ce0-339d-419c-a3b8-4604ab587367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.418872 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.418845 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqv5\" (UniqueName: \"kubernetes.io/projected/b0333ce0-339d-419c-a3b8-4604ab587367-kube-api-access-hzqv5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nxk5m\" (UID: \"b0333ce0-339d-419c-a3b8-4604ab587367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.557118 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.557030 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:05.713342 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:31:05.713297 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0333ce0_339d_419c_a3b8_4604ab587367.slice/crio-b2291f39d8ec687409376cecc18b2be55bf811566059e3540c46e9dc2388dd86 WatchSource:0}: Error finding container b2291f39d8ec687409376cecc18b2be55bf811566059e3540c46e9dc2388dd86: Status 404 returned error can't find the container with id b2291f39d8ec687409376cecc18b2be55bf811566059e3540c46e9dc2388dd86 Jun 02 19:31:05.714196 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.714169 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m"] Jun 02 19:31:05.715729 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:05.715713 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:31:06.689349 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:06.689315 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" event={"ID":"b0333ce0-339d-419c-a3b8-4604ab587367","Type":"ContainerStarted","Data":"98192ea9552296b5b46a3283e3791d093ee933be3cd6d52c42f349c61708dbfa"} Jun 02 19:31:06.689349 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:06.689352 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" event={"ID":"b0333ce0-339d-419c-a3b8-4604ab587367","Type":"ContainerStarted","Data":"b2291f39d8ec687409376cecc18b2be55bf811566059e3540c46e9dc2388dd86"} Jun 02 19:31:06.689816 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:06.689374 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:31:06.729172 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:06.729115 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" podStartSLOduration=1.729098666 podStartE2EDuration="1.729098666s" podCreationTimestamp="2026-06-02 19:31:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:31:06.727381663 +0000 UTC m=+1636.845185398" watchObservedRunningTime="2026-06-02 19:31:06.729098666 +0000 UTC m=+1636.846902400" Jun 02 19:31:17.694608 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:31:17.694571 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nxk5m" Jun 02 19:33:50.568458 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:33:50.568426 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:33:50.573327 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:33:50.573308 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:38:50.603605 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:38:50.603562 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:38:50.609659 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:38:50.609640 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:41:05.950946 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:05.950915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76d7946f8d-46gfw_61fc0352-3d7b-47c6-a753-dc663e95bba4/nginx/0.log" Jun 02 19:41:06.194175 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:06.194148 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-dl469_bdaf7970-3491-4095-b79d-86247de42ef8/manager/0.log" Jun 02 19:41:06.311548 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:06.311470 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-2gc5c_dae57c58-0eec-46a5-ad95-53a46b2cd93d/manager/0.log" Jun 02 19:41:06.432147 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:06.432120 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-75c6b6c5cb-fzh2j_2250b23b-c3cc-4f89-99af-debd1188b7f6/maas-api/0.log" Jun 02 19:41:06.766958 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:06.766924 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-9xzgg_4fa76471-cab6-4da5-8f41-26db170bcca5/server/0.log" Jun 02 19:41:06.880290 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:06.880243 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-xwp7b_4333b569-7ec2-42db-a99c-f61acf4c4db4/manager/0.log" Jun 02 19:41:07.003325 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:07.003296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-2d2gh_dff039bc-5df8-40d9-ad6a-87d6567723a4/copy-manifests/0.log" Jun 02 19:41:07.020217 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:07.020128 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-2d2gh_dff039bc-5df8-40d9-ad6a-87d6567723a4/manager/0.log" Jun 02 19:41:08.159625 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.159596 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv_1c205bcb-a249-484d-afd5-36dcb89dca43/util/0.log" Jun 02 19:41:08.168678 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.168626 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv_1c205bcb-a249-484d-afd5-36dcb89dca43/pull/0.log" Jun 02 19:41:08.176566 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.176539 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv_1c205bcb-a249-484d-afd5-36dcb89dca43/extract/0.log" Jun 02 19:41:08.301310 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.301276 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l_d36ccbef-044f-4d71-acde-db3f72260af5/util/0.log" Jun 02 19:41:08.308803 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.308785 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l_d36ccbef-044f-4d71-acde-db3f72260af5/pull/0.log" Jun 02 19:41:08.316794 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.316774 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l_d36ccbef-044f-4d71-acde-db3f72260af5/extract/0.log" Jun 02 19:41:08.435868 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.435769 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj_6f78c40d-1045-4d99-8024-0098da3a1b9c/extract/0.log" Jun 02 19:41:08.443358 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.443333 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj_6f78c40d-1045-4d99-8024-0098da3a1b9c/util/0.log" Jun 02 19:41:08.451613 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.451595 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj_6f78c40d-1045-4d99-8024-0098da3a1b9c/pull/0.log" Jun 02 19:41:08.585059 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.585029 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk_496d738e-6496-4a38-8135-9a1b9a2b1834/extract/0.log" Jun 02 19:41:08.592042 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.592017 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk_496d738e-6496-4a38-8135-9a1b9a2b1834/util/0.log" Jun 02 19:41:08.598806 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:08.598784 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk_496d738e-6496-4a38-8135-9a1b9a2b1834/pull/0.log" Jun 02 19:41:09.320633 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:09.320596 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-nxk5m_b0333ce0-339d-419c-a3b8-4604ab587367/manager/0.log" Jun 02 19:41:09.576073 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:09.576037 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-lfzdx_282f082f-bf6f-4ff9-8dc2-c48a67aa404f/manager/0.log" Jun 02 19:41:10.028154 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:10.028078 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-kjk86_db7e6b0f-93b6-4a6b-b85c-afd87d644014/discovery/0.log" Jun 02 19:41:10.244958 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:10.244927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79d759cb56-jscmc_b3e0a33d-ac93-4a1b-a84f-f953818a536b/kube-auth-proxy/0.log" Jun 02 19:41:11.308702 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:11.308664 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp_51d37469-cec7-4ac2-827d-602dadb0cb73/main/0.log" Jun 02 19:41:11.316795 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:11.316761 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f94qmrp_51d37469-cec7-4ac2-827d-602dadb0cb73/storage-initializer/0.log" Jun 02 19:41:11.423029 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:11.422998 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq_bea7ea4f-694f-43f8-9e06-67a380e1a706/storage-initializer/0.log" Jun 02 19:41:11.430331 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:11.430307 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-27chq_bea7ea4f-694f-43f8-9e06-67a380e1a706/main/0.log" Jun 02 19:41:11.539802 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:11.539774 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4_da809539-bbc7-439a-a1cf-12fb01f63910/storage-initializer/0.log" Jun 02 19:41:11.547849 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:11.547827 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-28db4_da809539-bbc7-439a-a1cf-12fb01f63910/main/0.log" Jun 02 19:41:18.487428 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:18.487396 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bp4vh_295b2bad-5e16-438c-a93c-651780b57362/global-pull-secret-syncer/0.log" Jun 02 19:41:18.672518 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:18.672488 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s9rb9_d54b6a72-108f-4b65-8683-3965d71ea404/konnectivity-agent/0.log" Jun 02 19:41:18.767756 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:18.767640 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-39.ec2.internal_bc70752037b9bb415bdf82e94ddddd38/haproxy/0.log" Jun 02 19:41:22.488923 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.488890 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv_1c205bcb-a249-484d-afd5-36dcb89dca43/extract/0.log" Jun 02 19:41:22.517905 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.517875 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv_1c205bcb-a249-484d-afd5-36dcb89dca43/util/0.log" Jun 02 19:41:22.545068 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.545027 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x9jbv_1c205bcb-a249-484d-afd5-36dcb89dca43/pull/0.log" Jun 02 19:41:22.576115 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.576087 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l_d36ccbef-044f-4d71-acde-db3f72260af5/extract/0.log" Jun 02 19:41:22.605642 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.605613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l_d36ccbef-044f-4d71-acde-db3f72260af5/util/0.log" Jun 02 19:41:22.643399 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.643368 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clk4l_d36ccbef-044f-4d71-acde-db3f72260af5/pull/0.log" Jun 02 19:41:22.679587 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.679556 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj_6f78c40d-1045-4d99-8024-0098da3a1b9c/extract/0.log" Jun 02 19:41:22.708811 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.708782 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj_6f78c40d-1045-4d99-8024-0098da3a1b9c/util/0.log" Jun 02 19:41:22.735786 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.735753 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7325sxj_6f78c40d-1045-4d99-8024-0098da3a1b9c/pull/0.log" Jun 02 19:41:22.768554 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.768475 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk_496d738e-6496-4a38-8135-9a1b9a2b1834/extract/0.log" Jun 02 19:41:22.800865 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.800835 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk_496d738e-6496-4a38-8135-9a1b9a2b1834/util/0.log" Jun 02 19:41:22.826767 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:22.826738 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147swk_496d738e-6496-4a38-8135-9a1b9a2b1834/pull/0.log" Jun 02 19:41:23.371030 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:23.370997 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-nxk5m_b0333ce0-339d-419c-a3b8-4604ab587367/manager/0.log" Jun 02 19:41:23.461842 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:23.461810 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-lfzdx_282f082f-bf6f-4ff9-8dc2-c48a67aa404f/manager/0.log" Jun 02 19:41:25.071895 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:25.071863 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-qfrz2_4e389a29-41e4-45f2-aa8d-a818d31852eb/monitoring-plugin/0.log" Jun 02 19:41:25.404862 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:25.404835 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v7n2c_2c34b7ef-161b-4068-960b-288cdf8439d7/node-exporter/0.log" Jun 02 19:41:25.435603 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:25.435578 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v7n2c_2c34b7ef-161b-4068-960b-288cdf8439d7/kube-rbac-proxy/0.log" Jun 02 19:41:25.479912 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:25.479878 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v7n2c_2c34b7ef-161b-4068-960b-288cdf8439d7/init-textfile/0.log" Jun 02 19:41:25.864652 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:25.864624 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-sgfhl_46ba56a2-6475-42ad-ab7b-2b48b1ed9747/prometheus-operator/0.log" Jun 02 19:41:25.890825 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:25.890804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-sgfhl_46ba56a2-6475-42ad-ab7b-2b48b1ed9747/kube-rbac-proxy/0.log" Jun 02 19:41:26.050186 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:26.050158 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f5658fd8-5bfj5_ebf633aa-b238-4ba8-9ed4-da43c0f14884/thanos-query/0.log" Jun 02 19:41:26.074791 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:26.074762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f5658fd8-5bfj5_ebf633aa-b238-4ba8-9ed4-da43c0f14884/kube-rbac-proxy-web/0.log" Jun 02 19:41:26.105589 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:26.105560 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f5658fd8-5bfj5_ebf633aa-b238-4ba8-9ed4-da43c0f14884/kube-rbac-proxy/0.log" Jun 02 19:41:26.134187 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:26.134105 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f5658fd8-5bfj5_ebf633aa-b238-4ba8-9ed4-da43c0f14884/prom-label-proxy/0.log" Jun 02 19:41:26.162564 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:26.162535 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f5658fd8-5bfj5_ebf633aa-b238-4ba8-9ed4-da43c0f14884/kube-rbac-proxy-rules/0.log" Jun 02 19:41:26.193217 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:26.193189 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f5658fd8-5bfj5_ebf633aa-b238-4ba8-9ed4-da43c0f14884/kube-rbac-proxy-metrics/0.log" Jun 02 19:41:28.656378 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.656349 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs"] Jun 02 19:41:28.659527 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.659501 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.662681 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.662660 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8wrw\"/\"openshift-service-ca.crt\"" Jun 02 19:41:28.662815 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.662708 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8wrw\"/\"kube-root-ca.crt\"" Jun 02 19:41:28.663904 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.663890 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d8wrw\"/\"default-dockercfg-pd7s2\"" Jun 02 19:41:28.673389 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.673363 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs"] Jun 02 19:41:28.739433 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.739401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-podres\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.739590 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.739439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-lib-modules\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.739590 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.739481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-sys\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.739590 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.739552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-proc\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.739590 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.739577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k47kz\" (UniqueName: \"kubernetes.io/projected/61c40394-ea30-49ba-b03f-ccdb57e1562e-kube-api-access-k47kz\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.840771 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840736 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-podres\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.840945 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840781 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-lib-modules\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.840945 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840831 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-sys\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.840945 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840858 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-proc\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.840945 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840876 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k47kz\" (UniqueName: \"kubernetes.io/projected/61c40394-ea30-49ba-b03f-ccdb57e1562e-kube-api-access-k47kz\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.841090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840943 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-sys\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.841090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840952 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-lib-modules\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.841090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-podres\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.841090 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.840959 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61c40394-ea30-49ba-b03f-ccdb57e1562e-proc\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.853851 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.853825 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k47kz\" (UniqueName: \"kubernetes.io/projected/61c40394-ea30-49ba-b03f-ccdb57e1562e-kube-api-access-k47kz\") pod \"perf-node-gather-daemonset-jkdgs\" (UID: \"61c40394-ea30-49ba-b03f-ccdb57e1562e\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:28.969849 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:28.969756 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:29.107279 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:29.107253 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs"] Jun 02 19:41:29.108834 ip-10-0-134-39 kubenswrapper[2582]: W0602 19:41:29.108803 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61c40394_ea30_49ba_b03f_ccdb57e1562e.slice/crio-efa65af4deaf1c21f03759fd48361f134208427082d9a1a9a4f3db7565c79af2 WatchSource:0}: Error finding container efa65af4deaf1c21f03759fd48361f134208427082d9a1a9a4f3db7565c79af2: Status 404 returned error can't find the container with id efa65af4deaf1c21f03759fd48361f134208427082d9a1a9a4f3db7565c79af2 Jun 02 19:41:29.110561 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:29.110540 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:41:29.132511 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:29.132435 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" event={"ID":"61c40394-ea30-49ba-b03f-ccdb57e1562e","Type":"ContainerStarted","Data":"efa65af4deaf1c21f03759fd48361f134208427082d9a1a9a4f3db7565c79af2"} Jun 02 19:41:29.823210 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:29.823176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t4bcr_12c0da33-5749-4e0c-ad2b-4e59c7f92ef7/dns/0.log" Jun 02 19:41:29.855466 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:29.855436 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t4bcr_12c0da33-5749-4e0c-ad2b-4e59c7f92ef7/kube-rbac-proxy/0.log" Jun 02 19:41:29.946477 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:29.946450 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sx9b5_38748609-4237-4055-92e5-748cfde31ac3/dns-node-resolver/0.log" Jun 02 19:41:30.137864 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:30.137829 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" event={"ID":"61c40394-ea30-49ba-b03f-ccdb57e1562e","Type":"ContainerStarted","Data":"5b4cb1ceb083d246595a1e217e3cbda0e13a60afeeb7b4279d8b9f77684a8827"} Jun 02 19:41:30.138046 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:30.137904 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:30.159266 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:30.159215 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" podStartSLOduration=2.159201105 podStartE2EDuration="2.159201105s" podCreationTimestamp="2026-06-02 19:41:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:41:30.156607585 +0000 UTC m=+2260.274411316" watchObservedRunningTime="2026-06-02 19:41:30.159201105 +0000 UTC m=+2260.277004866" Jun 02 19:41:30.499190 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:30.499116 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjv7r_3a839b66-3621-4f01-8a52-ce1a23d49318/node-ca/0.log" Jun 02 19:41:31.804506 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:31.804472 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-kjk86_db7e6b0f-93b6-4a6b-b85c-afd87d644014/discovery/0.log" Jun 02 19:41:31.867590 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:31.867561 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79d759cb56-jscmc_b3e0a33d-ac93-4a1b-a84f-f953818a536b/kube-auth-proxy/0.log" Jun 02 19:41:32.664574 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:32.664537 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xqs4x_ac01c952-5f11-433e-91c4-2f49af4b1b99/serve-healthcheck-canary/0.log" Jun 02 19:41:33.245024 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:33.244994 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4lj2x_f087363e-5a5b-4342-b97d-56ecd47ca28e/kube-rbac-proxy/0.log" Jun 02 19:41:33.277540 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:33.277508 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4lj2x_f087363e-5a5b-4342-b97d-56ecd47ca28e/exporter/0.log" Jun 02 19:41:33.305198 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:33.305168 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4lj2x_f087363e-5a5b-4342-b97d-56ecd47ca28e/extractor/0.log" Jun 02 19:41:35.513070 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.513038 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76d7946f8d-46gfw_61fc0352-3d7b-47c6-a753-dc663e95bba4/nginx/0.log" Jun 02 19:41:35.570512 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.570483 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-dl469_bdaf7970-3491-4095-b79d-86247de42ef8/manager/0.log" Jun 02 19:41:35.659981 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.659947 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-2gc5c_dae57c58-0eec-46a5-ad95-53a46b2cd93d/manager/0.log" Jun 02 19:41:35.697638 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.697609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-75c6b6c5cb-fzh2j_2250b23b-c3cc-4f89-99af-debd1188b7f6/maas-api/0.log" Jun 02 19:41:35.830668 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.830632 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-9xzgg_4fa76471-cab6-4da5-8f41-26db170bcca5/server/0.log" Jun 02 19:41:35.884951 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.884917 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-xwp7b_4333b569-7ec2-42db-a99c-f61acf4c4db4/manager/0.log" Jun 02 19:41:35.912820 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.912791 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-2d2gh_dff039bc-5df8-40d9-ad6a-87d6567723a4/manager/0.log" Jun 02 19:41:35.939656 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:35.939629 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-2d2gh_dff039bc-5df8-40d9-ad6a-87d6567723a4/copy-manifests/0.log" Jun 02 19:41:36.153033 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:36.152962 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-jkdgs" Jun 02 19:41:43.959148 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:43.959116 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/kube-multus-additional-cni-plugins/0.log" Jun 02 19:41:43.988638 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:43.988608 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/egress-router-binary-copy/0.log" Jun 02 19:41:44.024454 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.024424 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/cni-plugins/0.log" Jun 02 19:41:44.050913 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.050885 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/bond-cni-plugin/0.log" Jun 02 19:41:44.089470 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.089439 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/routeoverride-cni/0.log" Jun 02 19:41:44.137752 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.137717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/whereabouts-cni-bincopy/0.log" Jun 02 19:41:44.167595 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.167564 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2skj9_5dca2a65-a9ed-4cdf-9100-7c591e3f2b4c/whereabouts-cni/0.log" Jun 02 19:41:44.641598 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.641563 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-drvmn_23da05f4-d931-4366-86fe-fc67ceeeaa98/kube-multus/0.log" Jun 02 19:41:44.864642 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.864609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9h44x_f60ab9c9-dd63-42f3-927d-c54786d84726/network-metrics-daemon/0.log" Jun 02 19:41:44.941603 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:44.941523 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9h44x_f60ab9c9-dd63-42f3-927d-c54786d84726/kube-rbac-proxy/0.log" Jun 02 19:41:46.340487 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.340459 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-controller/0.log" Jun 02 19:41:46.365312 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.365277 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/0.log" Jun 02 19:41:46.375459 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.375429 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/ovn-acl-logging/1.log" Jun 02 19:41:46.399704 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.399666 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/kube-rbac-proxy-node/0.log" Jun 02 19:41:46.436410 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.436373 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 19:41:46.461380 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.461346 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/northd/0.log" Jun 02 19:41:46.491318 ip-10-0-134-39 kubenswrapper[2582]: I0602 19:41:46.491291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lfttw_1a21450a-8569-4423-828d-c6d81dfefeef/nbdb/0.log"